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AFH'^.L  CHAIN  OF  COMMAND 


THE  DEPARTMENT  OF  THE  AIR  FORCE 

The  mission  of  the  Department  of  the  Air  Force  is  "to  provide 
an  Air  Force  that  is  capable,  in  conjunction  with  the  other 
Armed  Forces,  of  preserving  the  peace  and  security  of  the  United 
States,  providing  for  its  defense,  supporting  the  national  pol¬ 
icies,  implementing  the  national  objectives,  and  overcoming  any 
nation  responsible  for  aggressive  acts  that  imperil  the  peace 
and  security  of  the  United  States."  Teamed  with  the  Army,  Navy, 
and  Marine  Corps,  the  Air  Force  is  prepared  to  fight  and  win  any 
war  if  deterrence  fails. 


AIR  FORCE  SYSTEMS  COMMAND 

Major  Commands  are  interrelated  and  complementary,  providing 
offensive,  defensive,  and  support  elements.  Each  support 
function,  such  as  logistics,  training,  and  research  and  develop¬ 
ment,  is  under  the  jurisdiction  of  a  separate  command.  Air 
Force  Systems  Command  (AFSC)  is  one  such  command.  Under 
policies  established  by  HQ  USAF,  AFSC's  mission  is  to  advance 
aerospace  technology,  to  incorporate  those  advances  in  the 
development  and  improvement  of  aerospace  systems,  and  to  acquire 
qualitatively  superior,  cost-effective,  and  logistically  sup¬ 
ported  aerospace  systems  and  equipment.  It  is  through  AFSC  that 
USAF ' s  operational  and  support  commands  receive  the  weapons, 
equipment,  and  initial  spare  parts  needed  to  defend  the  nation. 


AIR  FORCE  HUMAN  SYSTEMS  DIVISION 

The  Human  Systems  Division  (HSD>  is  a  subordinate  element  of 
AFSC,  HSD  plans,  manages,  and  conducts  research,  engineering 
development,  and  acquisition  programs  and  provides  specialized 
operational  support.  Its  efforts  focus  upon  the  readiness, 
maintenance,  protection  and  enhancement  of  human  capabilities 
and  human  system  performance  of  individuals,  teams,  crews,  and 
force  levels.  It  serves  as  a  center  for  human  systems  advocacy, 
enabling  the  Air  Force  to  meet  current  and  future  operational 
requirements  in  the  four  functional  areas  of  crew-system  inte¬ 
gration,  crew  protection,  force  readiness,  and  environmental 
protection. 

AIR  FORCE  HUMAN  RESOURCES  LABORATORY 

The  Air  Force  Human  Resources  Laboratory  (AFHRL),  an  organiza¬ 
tion  of  HSD,  has  the  responsibility  of  managing  and  conducting 
research,  exploratory  and  advanced  development  programs  for 
manpower  and  personnel,  operational  and  technical  training, 
simulation,  and  logistics  systems.  The  overall  goal  of  the 
combined  programs  is  to  assist  the  Air  Force  in  achieving  the 
best  methods  for  acquiring  enlisted  and  officer  members,  and 
training  and  maintaining  this  force  at  peak  readiness. 


AFSC  GOALS 


MEET  OUR  USERS  NEEDS 

•  Keep  Close 

•  Respond  to  Their  Requirements 

•  Be  Knowledgeable  of  Their  Environment 

MAINTAIN  ACQUISITION  EXCELLENCE 

•  Outstanding  People 

•  Productive  Teamwork 

•  Effective  Strategies 

ENHANCE  TECHNOLOGICAL  SUPERIORITY 

•  Nurture  the  Technology  Base 

•  Transition  to  Operating  Forces 


HUMAN  SYSTEMS  DIVISION 


'f  ^ 


^OftCE  '»‘G*N'Z4r/o^ 


% 


% 
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★  INNOVATION 

★  LEADERSHIP  ★  PRIDE 
★  INTEGRITY 


★  PURPOSE 


- PEOPLE - 

★  Stimulate  professional  development  and 
growth 

★  Foster  proper  career  development 

★  Recognize  initiative,  creativity,  and  innovation 


- ORGANIZATION - 

★  Enhance  quality  of  life 

★  Optimize  organizational  interfaces 

•k  Maximize  productivity  through  efficient 
business  practices 


PRODUCT 


★  Human  centered  systems  design  and 
development 

★  Enhanced  crew-system  integration 

★  Assured  crew  protection 


★  Increased  medical  and  force  readiness 

★  Optimum  environmental  protection 

★  Excellence  in  aerospace  medical  education 
and  training  programs 


Dedicated  To  Solving  The  Human  Challenges  In  Air  Force  Systems  And  Operations 


IV 


MESSAGE  FROM  THE  COMMANDER 


Let  the  word  go  forth  from  this 
time  and  place,  to  friend  and 
foe  alike,  that  the  torch  has 
been  passed  to  a  new  generation 
of  Americans,  born  in  this  cen¬ 
tury,  tempered  by  war,  disci¬ 
plined  by  a  hard  and  bitter 
peace,  proud  of  our  ancient 
heritage,  and  unwilling  to  wit¬ 
ness  or  permit  the  slow  undoing 
of  those  human  rights  to  which 
this  nation  has  always  been 
committed,  and  to  which  we  are 
committed  today  at  home  and 
around  the  world. 

Let  every  nation  know,  whether 
it  wishes  us  well  or  ill,  that 
we  shall  pay  any  price,  bear 
any  burden,  meet  any  hardship, 
support  any  friend,  and  oppose 
any  foe  to  assure  the  survival 
and  success  of  liberty. 

John  F.  Kennedy  (1917-1963) 

Inaugural  Address  (20  January  1961) 

These  words  come  to  mind  as  I  sit  back 
and  reflect  on  the  purpose  of  our  organi¬ 
zation,  the  Air  Force  Human  Resources 
Laboratory  (AFHRL).  And  I  ask  myself, 
"What  is  the  singular  function  of  AFHRL? 
Is  it  to  help  select  and  train  the  best 


pilots?  Is  it  to  support  increasingly 
sophisticated  weapon  systems  and  technol¬ 
ogy?  Is  it  to  carry  out  research  aimed 
at  making  a  more  efficient  and  effective 
work  force?  Is  it  to  design  the  best 
training  program  on  the  job  and  in  com¬ 
bat?"  The  purpose  of  AFHRL  is  all  of 
these  things,  yet  more.  For  in  the  most 
global  and  purest  sense,  our  purpose  is 
to  work  toward  the  preservation  of  free¬ 
dom  and  human  dignity. 

With  all  the  achievements  of  AFHRL,  it 
serves  me  well  to  step  back  and  simply 
look  at  the  bigger  picture,  and  try  to 
put  into  words  what  it  is  that  we  are 
actually  working  toward.  As  I  examine 
our  purpose,  our  challenges,  and  our 
accomplishments,  I  look  toward  our  hori¬ 
zons — where  we  have  been,  and  where  we 
arc  going.  And,  as  I  view  AFHRL,  1  think 
the  words  of  John  F.  Kennedy  capture  the 
essence  of  our  mission  and,  in  fact,  our 
being.  They  eloquently  state  our  purpose 
as  an  Air  Force  organization  that  serves 
an  important  role  in  our  Nation's  quest 
for  an  enduring  peace. 
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AFHRL  Headquarters  Building 


HUMAN  RESOURCES  LABORATORY  MAKES  VALUABLE  CONTRIBUTIONS  TO  THE  AIR  FORCE 

The  Air  Force  Human  Resources  Laboratory  to  develop  simulators  for  flight  and 

(AFHRL),  headquartered  at  Brooks  AFB,  maintenance  training;  and  logistics  and 

Texas  and  commanded  by  Col.  Harold  G.  human  factors  programs  in  weapon  systems 

Jensen,  is  the  principal  Air  Force  Sys-  acquisition  and  combat  maintenance, 

terns  Command  (AFSC)  organization  charged 

with  planning  and  executing  the  Air  Force  AFHRL  is  comprised  of  five  divisions 

exploratory  and  advanced  development  pro-  whose  overall  goal  is  to  assist  the  Air 

grams  for  research  and  development  (R&D)  Force  in  achieving  the  best  methods  of 

related  to  manpower  and  force  management,  acquiring  and  utilizing  enlisted  and 

logis  'cs  systems  technology,  and  train-  officer  members,  and  training  and  main- 

ing  technology.  taining  this  force  at  peak  readiness. 

The  AFHRL  mission  is  related  to  all  func-  There  are  four  research  divisions  within 

tional  areas  of  the  Air  Force  since  there  AFHRL,  located  in  various  parts  of  the 

is  no  area  that  escapes  the  requirement  United  States.  The  Manpower  and  Person- 

for  trained  and  qualified  personnel.  The  nel  Division,  Brooks  AFB,  develops  meth- 

Laboratory  executes  its  mission  through  ods  for  identifying  individuals  who  can 

R&D  programs  in  training,  personnel,  and  best  contribute  to  the  Air  Force  mission 

logistics  systems  technology.  These  and  techniques  to  assign  them  to  jobs 

include  programs  in  force  selection,  that  match  as  nearly  as  possible  their 

classification,  and  utilization;  programs  talents  and  preferences.  The  Training 

in  education  and  technical  training,  fly-  Systems  Division,  also  at  Brooks,  devel- 

ing  training,  and  team  training;  programs  ops  improved  individual  and  unit  training 
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methods  and  strategies  for  skills  devel¬ 
opment,  leading  to  effective  job  perform¬ 
ance.  Located  at  Wright-Patterson  AFB, 
Ohio,  the  Logistics  and  Human  Factors 
Division  focuses  on  computer  science, 
human  factors,  operations  research,  and 
engineering  skills  in  an  interdisciplin¬ 


ary  systems  approach  to  R&D  of  new  logis¬ 
tics  and  command/control  capabilities. 
The  Operations  Training  Division, 
Williams  AFB,  Arizona,  is  the  only  Air 
Force  agency  devoted  to  the  exploitation 
of  science  and  technology  to  improve 
aircrew  training. 


AIR  FORCE  HUMAN  RESOURCES  LABORATORY 
BROOKS  AFB,  TX 


TECHNICAL  PROGRAMS  AND  RESOURCES  OFFICE 

The  Technical  Programs  and  Resources 
Office  is  responsible  for  the  develop¬ 
ment  and  implementation  of  procedures 
and  policies  for  the  initiation  and 
execution  of  Research,  Development, 
Test,  and  Evaluation  (RDT&E)  programs 
for  AFHRL.  It  provides  overall  resource 
management  for  the  Laboratory,  which 
includes  all  Laboratory  funding  and 
funding  from  outside  sources.  The 
resource  function  develops  and  main¬ 
tains  resource  allocation  models  and 
is  responsible  for  planning,  organiz¬ 
ing,  and  executing  special  studies  to 
develop  recommendations  for  the  dis¬ 
tribution  of  resources  to  ongoing  and 
projected  RDT&E  programs.  The  Office 
provides  guidance  to  the  AFHRL  staff 
and  division  management  with  respect 
to  funding  levels  on  specific  RDT&E 
programs  and  provides  general  guidance 
and  oversight  to  the  transfer  and  tran¬ 
sition  of  AFHRL  technologies.  The 
Office  also  evaluates  Independent 
Research  and  Development  projects  of 
industry  and  tracks  Laboratory  accom¬ 
plishments  . 


SPECIAL  PROJECTS  OFFICE 

The  Special  Projects  Office  conducts 
studies,  analyses,  and  evaluations  of 
current  and  planned  AFHRL  programs  with 
respect  to  the  effective  use  of  AFHRL 
resources  and  conformance  with  Air 
Force,  AFSC,  HSD,  and  AFHRL  policies. 


The  studies  relate  to  any  aspect  of  R&D 
or  business  management  within  AFHRL. 
The  office  also  develops  and  evaluates 
plans  in  new  areas,  coordinates  plans 
with  other  organizations,  conducts  and 
monitors  front-end  analyses,  and  main¬ 
tains  liaison  with  other  laboratories 
and  user  organizations. 

EXECUTIVE  SUPPORT  OFFICE 

The  Executive  Support  Office  develops 
and  implements  policies,  procedures, 
and  standards  relating  to  administra¬ 
tion  management  and  practices,  military 
and  civilian  personnel  and  manpower 
actions,  and  materiel  actions.  The 
Office  provides  staff  guidance,  assis¬ 
tance,  and  surveillance  over  other 
echelons  in  areas  of  functional  respon¬ 
sibility  for  the  Laboratory  Commander. 

The  Office  staff  operates  the  following 
programs:  manpower  and  organization, 
reports  management,  documents  security, 
military  and  civilian  personnel  admin¬ 
istration  (including  training  pro¬ 
grams),  and  organizational  supply.  Fur¬ 
ther,  the  Executive  Support  Office  is 
the  principal  focal  point  for  host- 
tenant  support  agreements  for  the  Lab¬ 
oratory,  represents  the  Laboratory  in 
dealings  with  other  agencies  and  higher 
headquarters  in  all  areas  of  functional 
responsibilities,  and  serves  as  focal 
point  for  Inspector  General  visits  and 
reports . 


AFHRL  GEOGRAPHIC  LOCATIONS 
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LOGISTICS  AND  HUMAN  FACTORS  DIVISION 


The  Logistics  and  Human  Factors  Division 
(LR)  conducts  research  and  development 
(R&D)  on  maintenance  and  logistics  sys¬ 
tems,  team  training  (except  flying  train¬ 
ing)  ,  and  team  performance  in  ground- 
based  systems.  Logistics  R&D  includes 
developing  maintenance  aids  and  diagnos¬ 
tic  processes,  techniques  for  considering 
logistics  throughout  system  design  and 
acquisition,  methods  for  forecasting  lo¬ 


gistics  resource  requirements,  and  tech¬ 
niques  for  assessing  combat  maintenance 
readiness  and  capability  of  integrated 
logistics  systems.  LR  is  responsible  for 
team  performance  and  training  which  in¬ 
clude  development  of  content,  sequence 
and  media  with  emphasis  on  techniques  for 
training  of  command  and  control  (C^) 
teams,  as  well  as  ground-based  tjams  for 
space  operations. 


ACQUISITION  LOGISTICS  BRANCH  (LRA) 

The  objective  of  this  Branch  is  to  pro¬ 
vide  the  technological  components  of 
structured  engineering  information  sys¬ 
tems  and  automated  management  processes 
for  acquiring  more  supportable  and  sus¬ 
tainable  systems.  Key  program  areas 
address  the  exploitation  of  computer 
technology  for  designed-in  supportability 
and  the  integration  of  automated  techni¬ 
cal  information. 


A  modern  aerospace  vehicle  is  a  complex 
integration  of  sophisticated  technical 
systems  manufactured  to  the  exacting 
standards  required  to  achieve  mission 
performance,  cost,  safety,  and  schedule 
requirements.  The  complexity  of  the 
design,  manufacturing,  and  support  pro¬ 
cess  has  increased  significantly  as  a 
result  of  the  high  technology  employed. 
Traditional  methods  for  performing  these 
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functions  are,  however,  manpower  inten¬ 
sive  and  costly,  and  generate  enormous 
volumes  of  information  (paper)  which  must 
be  managed  manually.  The  application  of 
computer  technology  has  provided  the 
designer,  the  manufacturer,  the  manager, 
and  the  maintainer  with  the  capability 
to  dramatically  increase  their  productiv¬ 
ity.  Yet  these  capabilities  have  only 
partially  exploited  the  potential  for 
design,  manufacture,  support,  and  auto¬ 
mated  data  communication  between  these 
processes . 

Reliability,  Availability,  and  Maintain¬ 
ability  in  Computer-Aided  Design  (RAMCAD) 

AFHRL/LRA  is  conducting  R&D  that  will 
increase  productivity  throughout  the 
weapon  system  life  cycle  by  effectively 
utilizing  computer  technology  during  the 
acquisition  process.  The  Unified  Life 
Cycle  Engineering  (ULCE)  projects  will 
provide  the  design  engineer  with  the 
techniques  to  develop  reliable,  support¬ 
able,  and  producible  designs.  The  Inte¬ 
grated  Design  Support  (IDS)  System  will 
provide  the  weapon  system  manufacturers 
and  supporters  access  to  the  information 
generated  during  the  acquisition  process. 


This  effort  will  develop  analytical  mod¬ 
els,  computer  software,  data  bases,  and 
work  procedures  for  including  maintenance 
and  logistics  factors  in  the  CAD  of  sys¬ 
tems  and  equipment.  Computer-aided  en¬ 
gineering  techniques  have  helped  reduce 
the  design  burden,  making  it  possible  to 
now  incorporate  logistics  and  Reliability 
and  Maintainability  (R&M)  considerations 
during  the  initial  design  phases. 

A  wide  spectrum  of  CAD  technologies  for 
industrial  design  are  being  developed  in 
the  commercial  marketplace.  These  CAD 
technologies  substantially  enhance  draft¬ 
ing  capabilities  and  the  hardware  design 
process.  Since  maintenance  and  logistics 
considerations  are  not  formally  a  part 
of  the  drafting  process,  there  is  little 
industrial  motivation  to  develop  and 
incorporate  these  aspects  into  CAD. 

The  main  purpose  of  this  technology  is 
to  improve  designed-in  supportability  of 
weapon  systems.  This  will  be  accomplish¬ 
ed  in  three  ways:  (a)  more  reliable  avi¬ 
onics  through  the  automation  of  the  Avi¬ 
onics  Integrity  Program  (AVIP)  process; 
(b)  increasing  the  information  science 
technology  base  throughout  industry  and 


Effectively  using  computer  technology  during 
the  acquisition  process  will  increase  productivity. 
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Government  relating  to  supportabi lity  and 
producibility  analyses  (ULCE);  and  (c) 
aiding  the  general  automation  of  indus¬ 
trial  and  governmental  processes  in  the 
acquisition  and  logistics  areas  (CALS). 
CAD  technologies  substantially  enhance 
drafting  capabilities  and  the  hardware 
design  process.  One  major  aerospace 
company  has  estimated  a  15:1  payoff  for 
their  current  CALS  investments  if  applied 
to  a  five-year  major  weapon  system  dev- 
lopment  effort.  Improved  R&M  will 
significantly  lower  system  life-cycle 
costs  and  result  in  higher  states  of 
combat  readiness.  Other  direct  benefits 
include:  a  more  efficient  design  pro¬ 
cess;  more  explicit  trade-offs  in  the 
design;  and  better  R&M  analysis  tech¬ 
niques,  which  can  be  implemented  through¬ 
out  the  design  phase  of  weapon  system 
acquisition.  This  program  has  been 
divided  into  two  major  parts: 

(1)  A  series  of  high-visibility,  quick 
payoff  (less  than  two  years)  demonstra¬ 
tion  projects  to  provide  hard  evidence 
of  the  benefits  achievable  by  the  in¬ 
corporation  of  reliability,  maintainabil¬ 
ity,  and  logistics  into  CAD.  Demonstra¬ 
tions  were  conducted  using  the  Ground 
Launched  Cruise  Missile  and  the  F-15E  as 
platforms.  A  pair  of  demonstrations  on 
the  Integrated  Electronic  Warfare  System 
(INEWS)  will  be  completed  in  1988, 

(2)  A  longer-term  development  goal 
is  to  provide  a  minimum  standard  of  CAD- 
based  supportability  analysis  across  the 
aerospace  industry.  Included  is  the 
development  of  analytical  models,  comput¬ 
er  software,  data  bases,  users  manuals, 
and  specifications  for  a  fully  integrated 
reliability,  maintainability,  and  per¬ 
formance  engineering  CAD  capability. 

RAMCAD  also  includes  development  of 
techniques  through  a  university-industry 
consortium  and  demonstration  of  ongoing 
weapon  system  development  programs.  To 
ensure  continuity  of  effort,  close 
coordination  is  being  maintained  with  the 
National  Security  Industrial  Association 
working  group  on  RAMCAD  and  the  Joint 
Logistics  Commanders'  working  group  for 
RAMCAD.  The  final  demonstration  and 
test  of  RAMCAD  is  scheduled  in  FY90. 


RAMCAD  will  enable  engineers  to  develop 
reliable,  supportable,  and  producible 
designs . 

According  to  a  1985  AGARD  advisory 
report,  10  percent  of  American  design  is 
being  accomplished  using  computer-aided 
engineering  (CAE)  and  this  portion  is 
growing  at  a  30  to  50  percent  annual 
rate.  It  is  estimated  that  by  1995  this 
figure  will  be  nearly  80  percent. 

On  2^  September  1985,  Deputy  Secretary 
of  Defense  William  H.  Taft  IV  signed  a 
memorandum  approving  the  Office  of  the 
Secretary  of  Defense  (OSD)  Computer  Aided 
Acquisition  and  Logistics  Support  (CALS) 
initiative.  This  effort  requires  DOD  to 
automate  its  logistics  functions  by  1990 
and  has  three  objectives: 

(1)  Accelerate  the  integration  of  R&M 
design  tools  into  contractors'  computer- 
aided  design  and  engineering  processes. 

(2)  Accelerate  the  automation  of  con¬ 
tractor  processes  for  logistics  technical 
information. 

(3)  Rapidly  increase  DOD  capabilities 
to  receive,  distribute,  and  use  logistics 
technical  information  in  a  digital  form. 
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This  part  consists  of  three  tasks.  Task 
1  is  to  integrate  several  diverse  com¬ 
mercially  available  software  programs 
with  a  standard  CAE  system.  Task  2  is 
to  conduct  longer-range  R&D  on  technol¬ 
ogies  critical  to  the  success  of  RAMCAD. 
Task  3  is  directed  at  developing  an 
engineering  curriculum  incorporating 
RAMCAD  for  use  in  undergraduate  and  con¬ 
tinuing  education  programs.  This  will 
help  to  institutionalize  RAMCAD  in  the 
engineering  community.  These  efforts  will 
run  from  FY87  to  FY91. 

Contracts  have  been  awarded  for  RAMCAD 
software  development  to  TRW,  General 
Dynamics — Convair  Division,  and  Boeing 
Computer  Services,  supporting  work  under 
ULCE  to  develop  a  Decision  Support  System 
(DSS).  This  system  will  assist  engineers 
in  making  trade-offs  among  numerous  deci¬ 
sion  parameters. 

Contact:  Mr.  Alan  E.  Herner 

AFHRL/LRA 

Wright-Patterson  AFB  OH  45433 

Commercial:  (513)  255-3871 

AUTOVON:  785-3871 


These  objectives  were  reinforced  in  the 
recently  completed  Air  Force  Systems  Com¬ 
mand  Project  Forecast  II  Study,  in  which 
the  use  of  CAE  to  address  the  design  of 
weapon  systems  for  performance,  as  well 
as  for  manufacturing  and  support,  was 
identified  as  a  crucial  technology.  This 
Forecast  II  initiative  was  called  Unified 
Life  Cycle  Engineering  (ULCE).  RAMCAD 
forms  a  crit^'cal  part  of  both  the  OSD 
CALS  and  the  AFSC  ULCE  activities. 

The  second  portion  of  this  effort  will 
be  accomplished  through  a  tri-Service 
cooperative  effort  of  Government,  indus¬ 
try,  and  academia.  This  activity  will 
be  managed  by  the  Air  Force  Human  Re¬ 
sources  Laboratory  with  the  advice  and 
consent  of  a  board  of  advisors  from  the 
Army,  Navy,  the  Defense  Advanced  Research 
Projects  Agency,  the  Air  Force  Office  of 
Scientific  Research,  and  other  Air  Force 
laboratories.  In  this  way,  limited  re¬ 
sources  can  be  leveraged  for  maximum 
benefit  to  the  entire  DOD  community  while 
shortening  the  required  development  time. 


Computer-aided  design  will  assist  engineers 
in  making  trade-off  decisions. 


11 


Design  Analysis  Models  (CREW  CHIEF). 

Closely  related  to  the  RAMCAD  and  ULCE 
programs  is  the  CREW  CHIEF  project. 
Jointly  with  the  Harry  G.  Armstrong  Aero¬ 
space  Medical  Research  Laboratory 
(AAMRL) ,  LRA  is  developing  a  computer- 
aided  design  (CAD)  model  of  an  aircraft 
maintenance  technician.  This  model  will 
interface  with  existing  commercial  CAD 
systems  used  by  aerospace  manufacturers 
and  can  be  employed  by  them  to  improve 
the  maintainability  and  supportability 
of  Air  Force  aircraft.  By  providing  the 
designer  with  a  computer  simulation  of  a 
maintenance  technician,  maintainability 
analyses  can  be  performed  while  the 
system  is  still  on  the  computer-aided 
drawing  board.  Specifically,  CREW  CHIEF 
represents  the  correct  body  size  and 
proportions  of  a  maintenance  technician, 
the  encumbrance  of  clothing  and  personal 
protective  equipment,  mobility  limita¬ 
tions  for  simulating  working  postures, 
physical  access  for  reaching  into  con¬ 
fined  areas,  visual  access  and  strength 
capabilities. 


of  equipment,  tool  usage  within  access 
areas,  maintenance  operations  and  task 
requirements,  and  lifting  load  require¬ 
ments.  It  can  be  used  by  designers  to 
do  on-line  analysis  during  early  stages 
of  the  design  cycle. 

It  holds  the  promise  of  reducing  develop¬ 
ment  costs,  acquisition  time,  and  life 
cycle  costs.  The  largest  single  effort 
in  the  development  of  the  CREW  CHIEF 
model  is  the  R&D  to  gather  supplementary 
ergonomics  data.  Data  are  being  gathered 
regarding  manual  materials  handling  for 
the  appropriate  maintenance  technician 
working  postures,  torque  strength  capa¬ 
bility  for  wrenches,  and  electrical  con¬ 
nectors  and  visual  accessibility.  The 
data  base  will  be  expanded  in  the  future 
to  include  fatigue  factors.  Future  work 
is  planned  to  address  the  zero-gravity 
environment . 

Contact:  Mr.  John  lanni 

AFHRL/LRA 

Wright-Patterson  AFB  OH  45433 

Commercial:  (513)  255-3871 

AUTOVON:  785-3871 


This  R&D  will  develop  a 
computer  graphics  model  and 
supporting  data  bases  of 
Air  Force  technicians  (male 
and  female)  for  use  in 
computer-aided  methods  of 
evaluating  designs  of  wea¬ 
pon  systems  and  equipment. 
The  model  will  be  used  to 
perform  mockup-type  evalu¬ 
ations  of  new  weapon  sys¬ 
tems  and  equipment  designs. 
Humanlike  characteristics 
such  as  standing,  sitting, 
squatting,  crawling,  lift¬ 
ing,  pulling,  and  tool 
usage  will  be  featured  in 
the  model.  This  effort 
will  encompass  both  male 
and  female  technicians  and 
maintenance  work  in  both 
standard  work  clothing  and 
protective  equipment.  The 
model  will  be  capable  of 
evaluating  a  proposed  de¬ 
sign  in  maintainability 
terms  such  as  accessibility 


Aircraft  maintenance  will  be  enhanced  by 
development  of  CREW  CHIEF  model. 
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Unified  Data  Base 


An  additional  effort  within  LEIA  is  the 
Unified  Data  Base  (UDB).  The  UDB  is  a 
Logistics  Support  Analysis  data  base  sys¬ 
tem  designed  to  improve  the  documentation 
accessibility  of  acquisition  support 
data.  This  system  has  the  capability  of 
creating  an  acquisition  logistics  data 
base  which  can  be  used  by  Government  and 
contractor  personnel  to  eliminate  the 
need  for  the  paper-intensive  logistics 
documentation  systems.  The  UDB  is  an 
on-line,  fully  automated  system  capable 
of  producing  a  logistics  support  analysis 
record  (LSAR)  which  conforms  to  MIL- 
STD1388-2A.  It  will  provide  logisticians 
with  a  flexible,  efficient  data  base 
application  system  designed  to  ease  the 
burden  of  documenting  iterative  LSA 
tasks.  The  UDB  will  permit  rapid  docu¬ 
mentation  of  acquisition  logistics  data 
and  will  also  permit  the  data  to  be  used 
as  common  source  data  for  standard  con¬ 
tract  deliverable  data  items.  It  will 
facilitate  timely  analysis  feedback  to 
both  weapon  system  designers  and  Govern¬ 
ment  program  offices.  For  example, 
through  feedback  logistics,  requirements 
such  as  unique  support  equipment  and 
interim  contract  support  can  be  held  to 
minimum  levels. 

Contact:  Mr.  John  lanni 

AFHRL/LRA 

Wr ight-Patterson  AFB  OH  45433 

Commercial:  (513)  255-3871 

AUTOVON:  785-3871 


Integrated  Design  Support  (IDS)  System 

1 

Current  methods  used  to  store,  find,  and/ 
or  modify  paper-based  technical  informa¬ 
tion  over  the  life  cycle  of  weapon  sys¬ 
tems  are  grossly  inadequate  and  very 
expensive.  Further,  the  proliferation 
of  Computer-Aided  Design  (CAD)  systems 
has  produced  CAD  systems  which  cannot 
effectively  communicate  with  each  other. 
DOD  does  not  currently  obtain  or  retain 
adequate  technical  information  for  the 
complete  logistics  support  (remanufactur¬ 
ing,  third-party  parts  suppliers,  re¬ 
placements  for  obsolete  parts,  etc.)  of 


most  weapon  systems,  making  DOD  dependent 
on  primary  contractor  support  for  the 
life  of  the  weapon  systems.  In  addition, 
problems  associated  with  the  management 
of  technical  information  are  widespread 
and  well  known:  Engineering  drawings  are 
incomplete,  illegible,  and  difficult  to 
control;  paper-based  logistics  support 
data  are  voluminous  and  often  redundant; 
technical  manuals  rapidly  become  obsolete 
and  are  difficult  to  update;  data  reside 
in  a  heterogeneous  computer  environment 
and  generally  cannot  be  communicated  be¬ 
tween  dissimilar  computer  systems.  These 
kinds  of  problems  result  in  inflated 
costs  and  reduced  operational  capability. 

To  address  these  problems,  DOD  has  man¬ 
dated  that  all  new  major  weapon  systems 
must  acquire  technical  information  in 
digital  form  by  the  1990s.  Consequently, 
new  software  and  communication  architec¬ 
tures  are  required  to  provide  for  engi¬ 
neering  design,  technical  data  communica¬ 
tion,  coordination  and  preservation  for 
further  DOD  use  (e.g. ,  logistics,  mainte¬ 
nance,  remanufacturing,  technical  orders, 
etc).  The  Integrated  Design  Support 
(IDS)  program  is  an  information  systems 
R&D  effort  intended  to  provide  direct 
support  to  logistics  personnel  for  modi- 
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fication,  maintenance,  and  repair  of  Air 
Force  weapon  systems.  IDS  is  attempting 
to  solve  the  problems  of  organizing,  man¬ 
aging,  and  distributing  weapon  system 
technical  data  across  the  entire  life 
cycle  of  a  weapon  system.  Advanced  com¬ 
puter  technology  is  being  applied  to 
integrate  engineering  data  into  what  will 
appear  to  the  user  to  be  a  "single"  data 
base . 

The  IDS  program  will  develop  a  digital 
software  architecture  that  will  advance 
existing  design  considerations,  design 
specifications,  manufacturing  methods 
and  parts  fabrication  information.  It 
will  demonstrate  advanced  software  and 
communication  architectures  for  the 
coordination,  preservation  and  retrieval 
of  weapon  system  engineering  design 
technical  data  for  DOD  use  (logistics 
maintenance,  remanufacturing,  technical 
orders,  etc.).  IDS  is  essential  for  fu¬ 
ture  computer-based  technical  information 
systems  and  automated  engineering  data. 
Transition  will  be  through  specifications 
applied  on  new  systems  programs  and  by 
the  Air  Force  Logistics  Command  under  the 
overall  Air  Force  program  in  Computer 
Aided  Acquisition  Logistics  Support 
(CALS) . 

Initially,  IDS  will  define  the  critical 
subset  of  weapon  system  technical  in¬ 
formation  necessary  for  logistics 
support.  Next,  IDS  will  provide  the 
architecture  required  to  integrate  the 
collection  of  computer  systems  and 
software  which  are  currently  used  for 
the  management  of  this  information. 
Then,  IDS  will  produce  a  consistent  set 
of  program  requirements.  Next,  it  will 
develop,  demonstrate,  and  validate  a 
prototype  software  system  to  meet  these 
requirements.  This  will  provide  the 
foundation  for  full-scale  development  of 
a  production  IDS  system.  Finally,  the 
program  will  produce  a  tangible  cost 
benefit  analysis  to  justify  the  construc¬ 


tion  and  implementation  of  a  production 
IDS  system.  IDS  will  integrate  these 
data  using  a  mix  of  different  computer 
hardware  and  software  on  geographically 
separated  systems. 

IDS  is  creating  four  major  products:  an 
architecture  representing  the  require¬ 
ments  and  specifications  for  the  Inte¬ 
grated  Design  Support  System;  an  advanced 
prototype  system  demonstrating  proof  of 
concept  and  serving  as  a  laboratory  tool; 
technology  transfer  mechanisms  to  help 
the  movement  to  industry;  and  a  source 
of  technology  requirements  for  future 
weapon  system  information  management 
systems.  The  IDS  program  is  a  joint 
effort  with  the  AFWAL  Flight  Dynamics 
Laboratory.  Rockwell  Corporation  is  the 
prime  contractor. 

The  Phase  I  contract  will  be  completed 
in  FY88,  and  Phase  II  will  continue  to 
FY92.  An  industry  technical  advisory 
group  meets  regularly  to  review  and 
critique  progress  and  to  facilitate  the 
technology  transition. 

This  effort  is  essential  for  future 
computer-based  technical  information 
systems  and  automated  engineering  data. 
New  software  and  communication  architec¬ 
tures  are  required  to  provide  for  engi¬ 
neering  design,  technical  data  communi¬ 
cation,  and  data  coordination  for  other 
DOD  uses.  Most  of  these  technical  data 
are  available,  but  there  is  presently  no 
way  to  cost-effectively  obtain  and  retain 
such  data.  IDS  will  be  critical  in  pro¬ 
viding  an  Air  Force  capability  in  this 
regard.  A  prototype  IDS  system  demon¬ 
stration  in  a  production  environment  will 
be  completed  in  FY91. 

Contact:  Mr.  Mark  Hoffman 

AFHRL/LRA 

Wright-Patterson  AFB  OH  45433 

Commercial:  (513)  255-3871 

AUTOVON:  785-3871 
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LOGISTICS  SYSTEMS  BRANCH  (LRL) 

The  objectives  of  this  Branch  are  to  ex¬ 
tend  Air  Force  combat  planning,  opera¬ 
tions,  and  support  capabilities  through 
advanced  logistics  systems  analysis, 
model  development,  and  decision  support 
techno  log  ies . 

Specifically,  R&D  is  directed  toward 
incorporating  advanced  technologies  and 
methodologies  to  meet  war-fighting  cap¬ 
abilities  by  providing  the  tools  needed 
to:  (a)  compare  and  evaluate  deployment/ 
employment  and  support  concepts  of  oper¬ 
ations  and  predict  wartime  resource 
requirements;  and  (b)  enhance  the  cap¬ 
abilities  of  decision  makers  within  the 
support  structure. 

The  R&D  program  is  an  amalgam  of  explor¬ 
atory  research  and  advanced  development 
efforts  with  three  thrusts.  The  first  is 
basic  analytical  research.  The  second  is 
model  development  and  enhancement.  These 
will  provide  the  capabilities  to  evaluate 
logistics  supportability  in  situations 
requiring  responses  to  anticipated,  but 
diff icuLt-to-quantify  events.  The  third 
is  decision  support  technologies.  This 
R&D  program  involves  internal  efforts, 
as  well  as  cooperative  work  with  other 
branches,  divisions,  laboratories,  major 
commands,  and  the  academic  community. 

The  objective  of  the  first  thrust  is  to 
develop  basic  analytical  research  tools 


which  more  precisely  reflect  logistics 
impacts  throughout  the  acquisition  cycle. 
By  determining  relationships  through  the 
analysis  of  historical  combat  operations 
and  support,  we  can  extrapolate  results 
to  current  and  future  weapon  systems. 
Our  approach  is  to  analyze  historical 
combat  data,  validate  results  through 
comparisons  with  actual  results,  and  then 
apply  these  techniques  to  determining 
future  requirements. 

The  objective  of  the  second  thrust  is  the 
development,  enhancement,  and  application 
of  models,  simulation  methods,  and  system 
capability  assessment  tools.  These  will 
focus  on  logistics  demand-rate  forecast¬ 
ing,  operational  capabilities,  and  high- 
fidelity  requirements  assessment. 

The  objective  of  the  third  thrust  is  to 
incorporate  advanced  decision  support 
tools  for  use  by  system  designers,  ana¬ 
lysts,  managers,  and  users.  Our  effort 
on  the  Unified  Life  Cycle  Engineering 
(ULCE)  Decision  Support  System  supports 
this  objective.  The  intent  is  to  conduct 
the  R&D  that  will  ensure  overall  system 
interoperability  and  compatibility. 

Future  efforts  will  evaluate  and  address 
the  critical  interfaces  among  develop¬ 
ment,  logistics,  and  operations  systems. 
These  will  culminate  in  tools  essential 
to  increase  readiness  through  comparisons 
of  alternative  concepts  and  through  pro¬ 
visions  for  decision  support  systems. 


DEPICTION  OF  THE  C3I  PROCESS 


A  o 

BATTLEFIELD 


GROUND  OPERATIONS  BRANCH  (LRG) 

The  mission  of  this  Branch  is  to  improve 
the  combat  readiness  of  battle  managers 
and  their  staff  assigned  to  command  and 
control  (C^)  functions  through  applica¬ 
tion  of  advanced  training  and  human  per¬ 
formance  technology.  Work  accomplished 
has  supported  many  Air  Force  activities 
(e.g.,  United  States  Air  Forces  in  Europe 
(USAFE),  Tactical  Air  Command  (TAC),  Rome 
Air  Development  Center  (RADC),  9th  Air 
Force,  Electronic  Systems  Division  (ESD), 
and  others).  LRG  is  engaged  in  R&D  to 
improve  the  combat  readiness  of  battle 
managers  and  battle  staff. 

The  Branch  is  also  involved  in  programs 
with  other  laboratories  and  DOD  agencies. 
It  participates  with  the  Electronic  Sys¬ 
tems  Division  (ESD)  in  the  Strategic 
Defense  Initiative  (SDI),  and  in  the 
Battle  Management /Command ,  Control,  and 
Communications  (BM/C^)  program  continued 


through  membership  in  their  BM/C^  Fusion 
Working  Group.  The  goal  of  this  group 
is  to  keep  the  disparate  BM/C^  efforts 
coordinated  and  mutually  supportive.  Sig¬ 
nificant  involvement  was  established  in 
tiie  Naval  Research  Laboratory  (NRL)  SDI 
mid-course  BM/C^  program  through  the  pro¬ 
vision  of  human  factors  and  C^  knowledge 
to  NRL ' s  Human  Interface  Working  Group. 
Additionally,  we  joined  the  membership  of 
the  Battle  Management  Working  Group  for 
the  Atmospheric  Defense  Initiative  (ADI), 
the  air  defense  companion  to  SDI.  Sup¬ 
port  was  given  to  the  USAF  School  of 
Aerospace  Medicine  (USAFSAM)  Generic  C^ 
Workstation  Project,  a  lead-in  effort  for 
their  Aircrew  Evaluation  Sustained  Opera¬ 
tions  Performance  (AESOP)  Facility.  The 
support  included  assistance  with  scenario 
scoping/development,  hardware  and  soft¬ 
ware  requirements  determination/scoping, 
and  facility  development  planning. 
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An  important  Branch  program  is  to  develop 
new  technologies  for  analysis  of 
tasks.  Traditional  task  analysis  tech¬ 
niques  are  not  well  suited  for  describing 
activities  performed  by  a  battle  staff 
in  a  tactical  system.  Traditional 

methods  rely  on  collecting  data  on  ob¬ 
servable  tasks  while  most  tactical 
systems  involve  non-observable  decision 
making.  To  meet  the  needs,  computer 
techniques  based  on  structural  interview¬ 
ing  of  battle  staff  personnel  are  being 
developed.  A  prototype  system  is  reach¬ 
ing  completion  and  will  be  validated  at 
the  Air  Support  Operations  Center, 
Bergstrom  AFB,  TX  in  FY88.  A  field 
testing  program  will  follow. 


A  new  program  was  initiated  in  FY87  to 
investigate  aspects  of  cognitive  psychol¬ 
ogy  that  may  influence  how  high-perform¬ 
ance  skills  may  be  trained.  Previous 
work  has  shown  that  certain  components  of 
tasks  can  be  decomposed  into  those  that 
are  effortless  and  those  that  require 
much  effort  to  learn  and  perform.  Work 
is  underway  to  develop  analytic  tech¬ 
niques  to  identify  those  task  components 
which  can  be  trained  relatively  rapidly. 
This  work  will  provide  the  opportunity 
to  develop  and  test  part-task  trainers 
for  high-performance  skills. 


Air  Force  Space  Command  (AFSPACECOM)  and 
AFHRL  are  collaborating  on  the  matching 
of  AFSPACECOM  R&D  requirements  with  AFHRL 
R&D  capabilities.  As  an  initial  step,  a 
small-scale  survey  was  conducted  with 
operational  personnel  with  relevant  ex¬ 
perience.  Interviews  were  conducted  for 
the  purpose  of  identifying  high-perform¬ 
ance-demand  situations  or  known  perform¬ 
ance  limitations. 

Plans  are  well  underway  to  enhance  the 
in-house  C^  training  R&D  facility. 
This  facility  will  be  used  to  conduct 
training  R&D  experiments  based  on  C^ 
scenarios.  The  R&D  will  focus  on  train¬ 
ing  for  battle  management  staffs.  Scien¬ 
tists  here  will  also  address  the  analysis 
of  decision  making.  This  is  aimed  at 
defining  and  understanding  the  knowledge 
structures  which  underlie  performance. 
Until  more  information  is  obtained  about 
these  phenomena,  little  can  be  done  to 
improve  battle  management  training.  The 
facility  itself  will  consist  of  worksta¬ 
tions  which  are  capable  of  emulating  a 
variety  of  functions  within  systems 
(e.g..  Tactical  Air  Control  System  (TAGS) 
space  operations).  The  facility  will 
also  support  other  relevant  Branch  and 
Division  R&D  projects. 

Contact:  Dr.  Lawrence  E.  Reed 

AFHRL/LRG 

Wright-Patterson  AFB  OH  45433 

Commercial:  (513)  255-8607 

AUTOVON:  785-8607 


Methods  to  Evaluate  Automation  in  Tacti¬ 
cal  Command  and  Control  (C^)  Systems 

Tools  do  not  exist  to  adequately  predict 
the  effects  of  increases  in  the  numbers 
and  complexity  of  automated  systems  in 
tactical  C^  systems;  the  manner  in 
which  the  automation  affects  operator  and 
system  performance  is  determined  only 
after  its  incorporation.  This  could 
become  a  very  real  problem  for  the  Air 
Force  when  the  current  407L  control 
equipment  of  the  Control  and  Reporting 
Centers  (CRCs)  and  other  radar-based 
elements  of  the  Tactical  Air  Control 
System  are  replaced  by  the  Modular 
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Control  Equipment  (AN/TYQ-23).  Better- 
prepared  and  fully  responsive  air  defense 
elements  will  be  achieved  through  the 
development  of  a  way  to  predict  changes 
in  operation,  training,  and  manning 
requirements,  by  automating  a  Control 
and  Reporting  Center  (CRC)  with  Modular 
Control  Equipment  (MCE),  as  well  as  the 
ability  to  make  such  predictions  for 
future  systems. 

Through  a  contract  with  BBN  Labs,  Inc., 
this  proof-of-concept  effort  will  deter¬ 
mine  if  a  tactical  control  center  can  be 
well  represented  using  a  structured  hier¬ 
archy  of  activity  scripts  (containing 
standardized  task  sequences).  The 
representation  will  be  tested  by  a  com¬ 
puterized  model  using  advanced  object- 
oriented  programming  techniques  derived 
from  artificial  intelligence  (AI)  R&D. 
Usage  of  AI  techniques  will  enable 
simultaneous  inclusion  of  several  human 
performance  theoretical  models  with  an 
application  blend  appropriate  for  the 
invoked  activity  script. 


Data  collection  on  the  CRC  processes, 
human  performance  (knowledges /rules/ 
behaviors),  and  MCE  system  is  approxi¬ 
mately  80  percent  complete.  Coding  of 
the  man/machine  topology  and  underlying 
models  has  been  initiated. 


Contact : 


Maj  Raymond  L.  Spaeth 
AFHRL/LRG 

Wright-Patterson  AFB  OH  45433 
Commercial;  (513)  255-8233 
AUTOVON:  785-8233 


Command  and  Control  (C^)  Training  Sys¬ 
tems 

The  evolution  of  the  C^  function  in 
the  Air  Force  is  increasing  both  the 
challenge  of  training  C^  teams  and  the 
payoff  of  such  training.  Future  C^ 
systems  will  involve  a  network  of  inter¬ 
dependent  nodes;  if  one  node  is  destroyed 
during  combat,  other  nodes  will  have  to 
assume  their  functions.  So,  C^  teams 
will  have  to  be  trained  to  perform  a 


wider  range  of  functions.  In  addition, 
the  complexity  of  battle  management  will 
increase.  With  this  increase  come 
additional  requirements  to  provide  both 
realistic  combat  training  opportunities 
and  system  design  guidance  to  ensure  that 
man-machine  interaction  requirements/ 
design  supports  these  increased  opera¬ 
tional  demands.  Consequently,  training, 
human  performance,  wargaming,  system  de¬ 
sign,  and  battle  management  decision  mak¬ 
ing  have  emerged  as  major  R&D  interests. 


( 1 )  Training  to  Improve  Team  Per¬ 
formance.  This  effort  will  develop 
technology  to  improve  combat  readiness 
training  of  individuals  and  teams 
assigned  to  the  operational  and  logistics 
elements  of  the  theater  and  force  manage¬ 
ment  levels — Tactical  Air  Forces  (TAF). 
Part  of  the  R&D  will  be  to  investigate 
the  best  ways  of  training  personnel  on 
the  most  effective  methods  to  use  when 
preparing  air  tasking  orders  (ATOs)  and 
on  training  methods  for  high-level 
battle  management  decision  making.  In 
order  to  collect  accurate  and  detailed 
information  on  wartime  jobs  (functions 
and  tasks),  an  in-house  effort  to  design 
and  develop  a  computerized  task  data 
collection/analysis  system  is  underway. 
When  combined  with  a  contracted  effort, 
this  new  capability  will  allow  collection 
of  both  procedural  and  decision-making 
data  at  the  job  site  for  positions 

in  strategic,  tactical,  and  space  sys¬ 
tems.  This  will  provide  the  Air  Force 
with  an  accurate,  timely,  and  comprehen¬ 
sive  data  base  for  use  in  requirements 
analysis,  training,  assignments,  system 
design,  and  operation.  To  improve  the 
quality  and  reduce  the  cost  of  training 
and  exercising  battle  staffs,  work 

aimed  at  developing  both  a  better  under¬ 
standing  of  complex  decision  making  and 
exercising/war-gaming  is  underway.  The 


AFHRL  is  responding  to  both  the  increased 
challenge  and  the  increased  potential 
payoffs  by  enlarging  and  upgrading  its 
existing  facility  to  focus  on  realistic 
training  and  human  factors  R&D.  The 
facility  will  be  electronically  linked 
to  both  the  Harry  G.  Armstrong  Aerospace 
Medical  Research  Laboratory  and  the  Rome 
Air  Development  Center — two  other  Air 
Force  organizations  with  R&D 

responsibilities.  Linkages  to  other  DOD 
R&D  facilities  for  support  of  the 
strategic  defense  initiative  (SDI)  are 
also  planned.  The  upgraded  facility  will 
be  used  to  identify  better  ways  to  train 
teams  to  function  in  all  domains  — 


tactical 

,  strategic, 

and 

space  opera- 

t ions . 

The  C2 

R&D  program 

will 

continue  to 

provide 

three  kinds  of 

products : 
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work  will  include  investigations  of  human 
performance/decision  making  in  physically 
dispersed,  functionally  distributed  oper¬ 
ational  sites,  with  emphasis  on  the 
assessment  of  human  memory  capacity  and 
automaticity .  When  completed,  this  work 
will  lead  to  demonstration  training  pro¬ 
totypes,  system  design  guidance,  and 
exercise/war-gaming  recommendations  for 
the  operational  forces.  New  analysis 
technology  to  accurately  identify,  col¬ 
lect,  and  manage  the  actual  wartime 
training  requirements  for  selected 
positions  in  the  Tactical  Air  Control 
Centers  (TACCs)  will  be  developed.  Work 
will  also  be  conducted  to  develop  knowl¬ 
edge-engineering-based  tools  to  provide 
customized,  adaptive  training  programs 
for  functional-level  training  in  tactical 
C^  operations.  The  potential  value  of 
photographic-based  visual  imagery  will 
be  explored  through  a  series  of  in-house 
studies  to  determine  its  value  in  train¬ 
ing  C^  personnel.  Photogrammetric 
techniques  combine  photographic  images 
with  mapping  data  to  provide  representa¬ 
tions  of  actual  terrain.  The  use  of 
microcomputers  to  provide  in-garrison 
training  programs  will  be  investigated. 
Demonstration  prototype  microcomputer- 
based  exercise  and  training  programs 
will  be  developed  and  field  tested  for 
both  individual  and  team  training. 

(2)  C^  Performance  Assessment. 
This  R&D  identifies  variables  that  impact 
decision-making  performance,  and  develops 
and  validates  criterion  measures  for 
these  variables.  Without  these  measures, 
understanding  battle  management  processes 
is  not  fully  possible.  This  effort  will 
be  accomplished  in  two  phases.  The  first 
phase  will  extend  technology  now  used  in 
operational  evaluation  and  operations 
research,  and  incorporate  advancements 
in  CAD  technology  to  identify  newly  dis¬ 
tributed  decision-making  analysis  meth¬ 
odology.  The  second  phase  will  be  to 
develop  training/exercising  methods  to 
teach  these  skills  and  provide  design 
guidance  for  systems  to  support  distrib¬ 
uted  operations.  The  measures  will  be 
integrated  with  both  large  and  small  com¬ 
puter  simulations  now  being  used  to  train 
tactical  personnel.  Products  re¬ 


sulting  from  this  work  will  include:  (a) 
complex  information-processing/decision¬ 
making  analysis  methods,  (b)  embedded 
performance  recording  and  assessment 
techniques,  (c)  design  guidance  for  new 
decision-aiding  systems,  and  (d)  proto¬ 
type/training  data  base  demonstrations. 

(3)  Design  Guidance  and  Evaluation. 
Models  will  be  developed  to  describe  the 
internal  information  process  (flow)  for 
selected  elements  of  systems  to 

predict  the  impact  that  new,  automated 
equipment  and  software  will  have  on  the 

process.  Through  an  exploratory 
initiative  (6.1)  and  an  R&D  consortium 
with  the  University  of  Dayton,  Wright 
State  University,  and  the  AAMRL,  R&D  will 
be  conducted  to  gain  a  better  understand¬ 
ing  of  the  limitations  and  capabilities 
of  human  operators.  This  R&D  is 

necessary  to  perform  concept  definition 
work  for  software  design,  display  tech¬ 
nology,  and  systems  intended  to  aid  the 
decision  maker.  Later  work  will  document 
and  verify  design  guidance  and  standards 
for  use  by  RADC  and  the  Electronic  Sys¬ 
tems  Division  (ESD)  to  better  match  the 
characteristics  of  new  hardware/ 

software  systems  with  the  capabilities 
of  operators.  The  notential  value  of 
photographic-based  visual  imagery  to  im¬ 
prove  tactical  operations  will  be 

investigated.  Work  will  initially  focus 
on  display  requirements  and  use  of  over¬ 
laid  graphics.  It  will  continue  with 
investigation  of  the  actual  utility  of 
this  technology  for  specific  applications 
in  mission  planning,  and  comparisons  with 
the  effectiveness  of  current  systems. 
Products  resulting  from  the  R&D  on  design 
guidance  and  evaluation  include:  (a)  de¬ 
sign  data  and  recommendations  for  devel¬ 
opment,  application,  and  evaluation  of 
decision-aiding  devices;  (b)  design  data 
implications  for  the  system  operator  of 
functionally  distributed  tactical 
operations;  (c)  human  performance  design 
data  relevant  to  human  memory  capacity 
and  automaticity;  (d)  predictive  models 
of  system  processes;  (e)  user 

requirements  analysis  methods;  (f)  proto¬ 
type  system  to  assess  human  operator  re¬ 
quirements;  and  (g)  computer-aided  human 
performance  design  tools. 
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Contact:  Ms.  Wendy  Campbell 
AFHRL/LRG 

Wright-Patterson  AFB  OH  45433 
Commercial:  (513)  255-3871 

AUTOVON:  785-3871 

Knowledge-Based  C^  Decision-Making  Training 

The  effective  use  of  air  power  is  depend¬ 
ent  on  the  performance  characteristics  of 
the  aircraft  and  weapon  systems,  the 
ability  of  the  support  and  air  crews,  and 
the  expertise  of  the  battle  staffs  and 
battle  managers  who  control  and  direct 
these  assets.  One  critical  component  of 
this  capability  is  effective  training  for 
the  battle  managers  and  staffs  within  the 
tactical  command  and  control  (C^)  sys¬ 
tems.  This,  in  turn,  demands  a  methodol¬ 
ogy  to  determine  specific  wartime  train¬ 
ing  requirements  and  developments, 
tests,  and  demonstrations  of  training 
technologies  capable  of  providing  requir¬ 
ed  training.  The  benefits  of  this  R&D 
project  would  be  realistic  combat  scenar¬ 
io  exercises  and  training  programs  for 
personnel  assigned  to  tactical  sys¬ 

tems  . 

The  key  to  developing  decision-making 


performance  and  methods  of  an  expert  and 
then  develop  a  system  that  trains  the 
novice  to  think  like  an  expert.  Specifi¬ 
cally,  a  training  system  is  being  inves¬ 
tigated  that  repeatedly  exposes  the 
novice  to  prototypical  situations  and 
problems  in  his/her  domain.  This  will 
allow  the  novice  to  develop  the  schema 
which  underlie  an  expert's  performance. 
This  work  is  focused  on  the  Air  Support 
Operations  Center  (ASOC).  Through  a  con¬ 
tract  to  Logicon,  Inc.,  the  Ground  Oper¬ 
ations  Branch  (LRG)  will  determine  if 
expert  systems  technology  can  be  used  to 
develop  decision-making  training  for 
battle  managers.  This  R&D  focuses  on  two 
major  issues:  (a)  Can  expert  system  and 
knowledge  engineering  techniques  be  used 
to  make  explicit  the  task  knowledge  em¬ 
ployed  by  an  expert  battle  manager?  (b) 
Can  the  knowledge  base  developed  by  this 
technique  be  employed  as  a  component  of 
some  form  of  computer-based  training 
system? 

Data  collection  on  job  performance  skill 
requirements  for  fighter  duty  officers 
(FDD)  assigned  to  a  CONUS- based  ASOC  is 
underway.  Prototype  training  program 
development  will  begin  in  FY88, 


training  is  to  first  understand  the 


Contact:  Mr.  Michael  J.  Young 
AFHRL/LRG 

Wright-Patterson  AFB  OH  45433 
Commercial:  (513)  255-8229 

AUTOVON:  785-8229 


Expert  entering  information  during  devel¬ 
opment  of  a  training  system 

COMBAT  LOGISTICS  BRANCH  (LRC) 

In  addition  to  the  Integrated  Maintenance 
Information  System  (IMIS)  R&D  program, 
the  Combat  Logistics  Branch  has  several 
programs  dealing  specifically  with  the 
performance  of  maintenance  personnel  in 
a  combat  environment.  It  is  expected 
that  a  future  war  would  find  maintenance 
technicians  being  subject  to  attacks  on 
their  work  place.  Some  scenarios  suggest 
that  maintenance  personnel  may  be  re¬ 
quired  to  perform  their  complex  tasks  in 
dispersed  operating  locations  with  limit¬ 
ed  personnel.  Technological  innovations 
are  needed  to  help  operational  organi/:a- 
tions  perform  under  such  conditions  and 
to  better  evaluate  their  ability  to  plan 
for  combat.  In  addition,  techniques  are 
needed  to  improve  the  performance  of 


maintenance  personnel  under  both  combat 
and  peacetime  operations. 

The  recently  completed  (FY87)  Combat 
Maintenance  Capability  (CMC)  Study  ex¬ 
amined  the  differences  between 
current  maintenance  of  modern 
combat  aircraft  and  future  com¬ 
bat  maintenance.  The  project 
focused  on  personnel  perform¬ 
ance,  wartime  usage  rates,  and 
evolving  support  concepts.  It 
provided  methodologies  for 
evaluating  current  capabilities 
and  predicting  future  combat 
capabilities . 

Because  it  is  anticipated  that 
in  future  wars,  combat  aircraft 
may  operate  out  of  dispersed 
bases,  the  Small  Unit  Mainte¬ 
nance  Manpower  Analysis  (SUMMA) 
effort  is  examining  the  impact 
of  dispersal  of  air  bases  on 
manpower  availability  and  de¬ 
veloping  alternative  solutions 
to  the  problem.  The  project 
focuses  on  ways  of  expanding  the  job/task 
scope  of  existing  maintenance  specialties 
and  evaluating  personnel  policies,  train¬ 
ing  policies,  and  management  initiatives 
that  will  facilitate  the  transition  to  a 
more  broadly  trained  and  capable  work 
force. 

It  is  well  known  that  Soviet  forces  have 
a  well-developed  capability  to  use  chem¬ 
ical  weapons  in  combat.  Air  Force  main¬ 
tenance  personnel  must  be  prepared  to 
operate  under  chemical  warfare  condi¬ 
tions.  The  Maintenance  Limitations  in  a 
Chemical  Warfare  Environment  Study  is 
developing  a  methodology  to  evaluate 
maintenance  capabilities  in  the  event 
that  chemical  weapons  are  used.  Products 
will  include  estimates  of  performance 
times,  recommendations  for  modifications 
to  the  chemical  defense  protective  suit, 
workarounds  for  difficult  tasks,  and 
recommendations  for  future  R&D. 


Technicians  in  protective  chemical  war¬ 
fare  clothing 

Past  experience  has  shown  that  serious 
losses  can  be  expected  from  stress  in 
combat  situations.  Since  maintenance 
personnel  will  be  expected  to  work  under 
excessive  stress,  it  is  necessary  to 
understand  how  the  performance  of  tech¬ 
nical  tasks  is  impacted  by  the  presence 
of  combat  stress.  The  Impact  of  Stress 
on  Combat  Maintenance  Operations  efforts 
will  examine  the  feasibility  of  various 
approaches  for  reducing  the  impact  of 
stress  on  maintenance.  The  approaches 
will  be  evaluated  in  terms  of  cost  and 
potential  payoff  and  the  most  promising 
approaches  tested  in  a  follow-on  field 
test . 

Each  of  the  efforts  described  above  will 
make  a  significant  contribution  to  im¬ 
proving  the  ability  of  maintenance  orga¬ 
nizations  to  support  combat  operations. 
However,  these  efforts  have  been  conduct¬ 
ed  and  the  products  evaluated  independ¬ 
ently.  It  is  essential  that  the  technol¬ 
ogies  and  the  anticipated  maintenance 
policies  and  structures  work  together 
effectively  to  support  combat  operations. 

The  Combat  Planning  and  Attack  Capability 
project  is  developing  a  plan  to  achieve 
and  demonstrate  the  integration  of  the 
technologies  described  in  the  preceding 
paragraphs  with  the  IMIS  technology.  The 


demonstration  will  evaluate  the  capabil¬ 
ity  of  a  maintenance  unit  to  generate 
required  sorties  while  operating  under 
predicted  combat  conditions  (using  the 
previously  described  technologies).  For 
the  first  time,  we  will  have  valid  meas¬ 
ures  of  the  effectiveness  of  these  new 
technologies  and  the  ability  of  the  test 
unit  to  support  the  combat  mission. 

Integrated  Maintenance  Information  System 
(IMIS) 

Changes  in  threats,  support  concepts,  and 
weapon  systems  technology  are  taking 
place  which  will  radically  alter  the  way 
maintenance  must  be  done  to  generate 
tactical  sorties  in  future  wars.  Air¬ 
craft  must  be  more  dispersed.  They  must 
depend  less  on  bulky  test  equipment  and 
large  on-site  facilities  for  off- 
equipment  maintenance.  Systems  will  be 
more  complex,  more  integrated,  and 
require  deeper  maintenance  on  the  line 
by  fewer  technicians  who  must  master  a 
broader  range  of  tasks  and  skills. 
Automation  will  only  increase  the  problem 
if  introduced  as  a  multiplicity  of  unique 
and  incompatible  information  "aids." 
AFHRL  is  developing  a  comprehensive 
information  and  job-aiding  system  to  help 
technicians  generate  the  needed  sorties 
in  this  environment. 

The  Air  Force  now  has,  or  is  developing, 
several  computer  systems  for  use  at  base 
level  to  support  maintenance  and  supply 
functions.  Unless  integration  occurs, 
the  Air  Force  of  the  future  will  have 
several  incompatible  computer  systems  on 
the  flight  line,  with  continuing  update 
requirements  for  each.  Confusion  will 
occur  with  possibly  incompatible  hard¬ 
ware,  data  requirements,  and  required 
training.  The  IMIS  development  will 
integrate  these  existing  and  developing 
systems  with  a  computer-based  technical 
information  system,  adding  diagnostic  job 
aids  to  increase  the  ability  of  techni¬ 
cians  to  troubleshoot  and  perform  a  wide 
range  of  maintenance  actions.  A  demon¬ 
stration  on  a  fielded  weapon  system 
(F-16  aircraft)  will  be  completed  in 
FY88.  The  IMIS  will  provide  an  inte- 
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grated  approach  to  total  weapon  system 
maintenance.  Technical  data,  training, 
diagnostics,  management,  scheduling,  and 
historical  data  bases  will  be  linked 
together,  and  a  portable  graphic  display 
job  aid  will  be  developed  to  present  the 
required  information  at  the  job  site. 
Interfaces  will  be  developed  for  aircraft 
computers  and  for  existing  and  emerging 
data  ba&es. 

Since  1976,  AFHRL  has  conducted  R&D  to 
develop  the  technology  for  the  presenta¬ 
tion  of  technical  data  on  an  automated 
system.  The  emphasis  was  placed  upon 
designing  technical  data  presentation 
techniques  and  procedures  tailored  to 
meet  the  technicians'  needs  and  make  it 
easier  for  them  to  do  the  job.  Emphasis 
was  placed  on  developing  data  access 
techniques  which  make  it  easy  to  locate 
the  information  and  developing  presenta¬ 
tion  formats  which  make  it  easy  to  use 
the  information.  Experienced  maintenance 
personnel  from  operational  units  have 
been  and  continue  to  be  involved  in  all 
phases  of  the  program  (as  consultants 
and  test  subjects)  to  ensure  that  the 
needs  of  the  maintenance  technician  are 


met  and  that  the  techniques  developed 
are  suitable  for  use  in  actual  mainte¬ 
nance  operations.  This  prior  work  will 
now  be  further  developed,  fully  inte¬ 
grated,  and  tested  in  a  complete  IMIS 
demonstration.  This  contractual  effort 
has  four  phases:  system  functional 

requirements  analysis;  system  design; 
prototype  development  and  fabrication; 
and  demonstration  and  field  evaluation. 
The  final  product  will  be  draft  military 
specifications  which  describe  the  func¬ 
tional  requirements  of  IMIS  and  outline 
how  to  adapt  IMIS  to  various  weapon  sys¬ 
tems  and  maintenance  concepts.  The 
specifications  will  include  information 
format,  content,  and  display  requirements 
for  the  technical  orders,  diagnostic, 
training,  and  management  information. 
Most  importantly,  the  specifications  will 
define  the  human  factors  and  human- 
machine  interface  requirements  for  the 
system. 

Contact:  Capt  Joseph  C.  Von  Holle 

AFHRL/LRC 

Wright-Patterson  AFB  OH  45433 

Commercial:  (513)  255-2606 

AUTOVON:  785-2606 


Prototype  PCMAS  unit  along  with  one  of 
the  data  cartridges  that  would  be  plug¬ 
ged  in  by  the  technician  using  the  unit 
as  an  aircraft  maintenance  aid  or  diag¬ 
nostic  tool. 
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TRAINING  SYSTEMS  DIVISION 


The  Training  Systems  Division  completed 
a  move  from  Lowry  AFB,  CO  to  Brooks  AFB, 
TX  at  the  close  of  1986.  All  Division 
personnel  are  now  at  Brooks  AFB  or  at  the 
operating  location  at  Bergstrom  AFB  near 
Austin,  TX.  The  primary  objective  of  the 
Training  Systems  Division  is  to  perform 
R&D  to  enhance  Air  Force  skills  develop¬ 
ment  and  job  performance  through  improved 
training  design,  delivery,  evaluation, 
and  management.  In  addition ,  the  Divi¬ 
sion  has  been  designated  the  primary 


Laboratory  center  for  artificial  intel¬ 
ligence  R&D,  and  in  particular,  its 
application  to  Air  Force  training. 

To  better  accomplish  the  R&D  mission,  the 
Division  has  been  reorganized  into  four 
branches,  each  named  for  its  R&D  thrust — 
the  Training  Technology  Branch,  Skills 
Development  Branch,  Intelligent  Systems 
Branch,  and  the  On-the-Job  Training 
Branch.  The  revised  Division  organiza¬ 
tional  chart  follows; 


The  Division's  R&D  efforts  are  currently  focused  on  seven  major  projects  or 
thrusts : 


Branch 

Projects 

Training  Technology 

Computer-Based  Training  R&D 

Instructional  Support  System 

Skills  Development 

Job  Performance  Measurement 

Training  Decisions  System 

Intelligent  Systems 

Tools  for  Applying  Artificial 

Intelligence  to  Training 

Intelligent  Tutoring  Systems 

On-the-Job  Training 

Advanced  On-the-job  Training  System 
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TRAINING  TECHNOLOGY  BRANCH 


The  Branch  develops  training  technology 
that  will  contribute  to  the  increased 
combat  capability  of  the  Air  Force.  The 
Branch's  current  program  focuses  on 
enhancement  of  the  Instructional  Support 
System  (ISS),  a  versatile,  state-of-the- 
art  software  system  for  designing,  devel¬ 
oping,  delivering,  evaluating,  and  manag¬ 
ing  computer-based  training. 

The  strategic  plan  for  future  R&D  broad¬ 
ens  the  Branch's  focus  on  training  tech¬ 
nology.  It  will  examine  a  large  variety 
of  user  issues  concerning  training  soft¬ 
ware  transportability,  reliability,  main¬ 
tainability  and  supportabi 1 ity .  Key 
among  these  issues  are  improved  training 
development,  delivery  and  management 
software  capabilities,  and  decision  meth¬ 
odology  for  matching  available  computer- 
based  training  systems  to  user  needs.  The 
overriding  strategic  goal  is  to  establish 
the  Laboratory  as  the  Air  Force's  center 
of  expertise  for  the  application  of  com¬ 
puter  and  computer-related  technologies 
to  Air  Force  training. 

Instructional  Support  System  (ISS) 

The  advent  of  computer  applications  to 
training  has  led  to  a  multiplicity  of 
hardware  and  software  systems.  Proprie¬ 
tary  righis,  vendor  and  machine  depend¬ 
ence,  and  lack  of  software  and  courseware 
transportability  were  inevitable  conse¬ 
quences.  These  factors  have  tended  to 
keep  the  acquisition  and  life-cycle  costs 
of  commercial  systems  high  and,  as  a 
result,  inaccessible  to  many  potential 
Air  Force  users.  The  approach  in  devel¬ 
oping  the  ISS  was  to  eliminate,  or  at 
least  minimize  to  the  extent  feasible, 
the  effects  of  these  variables.  The  end 
result  is  a  Government-owned,  Ada  soft¬ 
ware  package  for  computer-based  training 
that  is  machine  and  operating  system  in¬ 
dependent,  and  that  is  easily  modifiable 
to  permit  incorporation  of  future  hard¬ 
ware  and  software  advances.  The  ISS  can 
be  used  to  address  a  training  requirement 
without  being  dependent  on  a  particular 
vendor-supplied  hardware/software  pack- 


The  demand  for  ISS  is  extensive. 

age.  Also,  the  users  can  tailor  the  sys¬ 
tem,  through  its  modular  design,  to  their 
unique  needs  rather  than  having  to  re¬ 
strict  or  modify  their  requirements  to 
fit  the  system. 

The  Air  Force  accepted  ISS  as  a  prototype 
on  the  VAX  11/780  minicomputer  in  October 
1985.  The  Strategic  Air  Command  at  Dyess 
AFB,  TX  has  served  as  the  system  testbed 
using  ISS  to  develop,  deliver,  and  manage 
170  hours  of  online  courseware  to  train 
350  B-IB  pilots  'ind  navigators. 

In  addition  to  operating  on  the  VAX  11/ 
780,  11/785  and  8600,  the  ISS  was  rehost¬ 
ed  during  FY87  to  the  MicroVax  II. 
Videodisc  capability  was  added  and  a 


compact  Micro  Computer-Managed  Instruc¬ 
tion  (CMI)  capability  was  developed  for 
microcomputer  implementations.  Export¬ 
able  online  and  offline  training  courses 
have  been  developed  for  the  Computer- 
Assisted  Instruction  (CAI)  and  CMI  sub¬ 
components  of  ISS.  ISS  is  being  rehosted 
to  the  Zenith  248  (Air  Force  standard) 
microcomputer,  which  will  greatly  expand 
ISS  accessibility  to  Air  Force  users. 
The  rehosting  of  the  instructional  soft¬ 
ware  portion  of  the  ISS  was  completed  in 
December  1987,  with  the  authoring  portion 
following  in  early  spring  1988.  Training 
management  will  be  rehosted  in  FY89.  A 
transition  plan  is  being  finalized  to 
move  ISS  from  the  laboratory  environment 
to  a  long-term  support  agency.  Data 
structure,  data  base  and  within-code 
application  software  documentation  were 
developed  to  aid  in  transitioning  the  ISS 
to  a  long-term  support  agency.  Transition 
of  the  VAX-based  ISS  to  the  Human  Systems 
Division  for  full-scale  development  is 
planned  during  FY88,  to  be  followed  in 
FY89  by  the  Z-248  version. 

Contact:  Dr.  Scott  Newcomb 

AFHRL/IDC 

Brooks  AFB  TX  78235-5601 
Commercial:  (512)  536-3992 

AUTOVON:  240-3992 


SKILLS  DEVELOPMENT  BRANCH 

This  Branch  conducts  R&D  to  improve 
training  planning,  the  evaluation  of 
training,  and  the  acquisition  of  job 
skills  through  training.  Presently, 
these  programs  include:  (a)  the  Training 
Decisions  System  (TDS),  a  computer-based 
decision  system  enabling  training  man¬ 
agers  to  optimize  training  planning,  pro¬ 
gramming,  and  budgetary  decisions;  and 
(b)  the  Job  Performance  Measurement  Sys¬ 
tem,  a  technology  for  collecting  accurate 
and  reliable  job  performance  information 
which  may  be  used  to  evaluate  and  improve 
the  selection,  classification,  and  train¬ 
ing  of  airmen.  Future  programs  will  in¬ 
clude  R&D  to  enhance  the  way  Air  Force 
training  is  developed  and  conducted. 


Job  Performance  Measurement  (JPM) 

The  Job  Performance  Measurement  (JPM)  R&D 
program  is  developing  a  technology  to 
objectively  measure  the  job  performance 
of  airmen.  This  R&D  program  will  provide 
cost-effective  job  performance  measure¬ 
ment  procedures  that  can  be  used  to  col¬ 
lect  performance  information  for  setting 
enlistment  and  classification  standards 
or  developing  and  evaluating  training. 
This  technology  will  help  improve  the 
match  between  people  and  jobs  throughout 
the  Air  Force  and  provide  commanders  and 
supervisors  with  personnel  who  possess 
the  knowledge  and  skills  required  to 
accomplish  the  mission. 

This  R&D  effort  received  its  impetus  from 
two  basic  areas.  First,  Congress  re¬ 
quested  the  DOD  to  determine  the  rela¬ 
tionship  of  the  Services'  selection 
standards  (Armed  Services  Vocational 
Aptitude  Battery)  to  on-the-job  (OJT) 
performance,  rather  than  to  training  per¬ 
formance.  This  request  led  to  the  forma¬ 
tion  of  a  joint-Service  working  group 
with  members  from  the  Army,  Navy,  Marine 
Corps,  and  Air  Force  research  communi¬ 
ties,  and  oversight  provided  by  a  Nation¬ 
al  Academy  of  Sciences  Committee.  The 
second  push  for  this  research  came  from 
Air  Training  Command  (ATC)  and  the  Air 
Force  Military  Personnel  Center.  Their 
interest  was  in  (a)  improving  the 
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ability  to  predict  success  in  the  Air 
Force  (i.e.,  identify  the  best  perform¬ 
ers)  by  integrating  job  performance 
information  into  the  selection  and  clas 
sification  systems,  and  (b)  assessing  the 
effectiveness  of  Air  Force  training  pro¬ 
grams  and  making  modifications,  where 
needed,  based  on  how  well  graduates  per¬ 
form  on  the  job.  Thus,  the  overarching 
benefit  of  the  Air  Force  JPM  project  is 
a  more  efficient  and  cost-effective  per¬ 


sonnel  accession  and  training  system. 


> 
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A  goal  of  performance  measurement 
technology  is  to  provide  the  Air  Force 
with  more  well -trained  personnel. 


Monitor  evaluates  hands-on 
performance  of  jet  engine  mechanics. 


development  of  job  performance  measures 
incorporates  expert  review  from  active- 
duty  personnel  in  Air  Force  specialties. 


Ferformance  measure¬ 
ment  technology  uses 
on-equipment,  task- 
level  evaluations. 


Currently,  the  Air  Force  JPM  R&D  effort 
centers  on  the  development  of  a  Job 
Performance  Measurement  System  (JPMS)  for 
eight  enlisted  specialties.  The  JPMS  con¬ 
sists  of  hands-on  work  sample  tests  and 
a  variety  of  additional  job  performance 
measures  which  could  prove  to  be  cost- 
effective  substitutes  for  the  hands-on 
measures.  The  most  detailed,  task- 
oriented  Air  Force  measurement  technique 
being  developed  for  the  JPMS  is  called 


The  JPM  technology  has  also  been  applied 

Walk-Through  Performance  Testing  ^WTPT). 

The  WTPT  is  comprised  of  two  major  com¬ 
ponents:  observation  of  actual  hands-on 
performance  and  interview  testing.  Inter¬ 
view  testing  is  designed  to  approximate 
a  hands-on  assessment  as  closely  as  pos¬ 
sible,  by  using  a  "show  and  tell"  proce¬ 
dure  at  the  work  site. 

Although  the  hands-on  portion  of  the  WTPT 
gives  the  best  measure  of  an  airman's 
actual  job  proficiency  that  is  currently 
possible,  such  testing  is  expensive  and 
time-consuming.  Thus,  several  other  al¬ 
ternative  measures  to  interview  testing 
are  being  developed  as  part  of  the  JPMS. 
These  "surrogates"  are  gauged  against  the 
hands-on  measure  in  terms  of  their  cost 
effectiveness  and  the  validity  of  the 
information  they  provide.  The  surrogates 
currently  being  developed  include  rating 
forms  and  written  knowledge  tests.  After 
an  extensive  period  of  testing  and  revi¬ 
sion,  the  JPMS  for  each  AFS  will  be 
administered  by  highly  trained  enlisted 
personnel  selected  because  of  their 
expertise  in  the  particular  specialty. 

In  FY87,  the  JPM  R&D  accomplishments  in¬ 
cluded  (a)  analysis  of  data  in  one 
enlisted  specialty  and  data  collection 
in  four  others,  (b)  development  of  JPM 
instruments  for  four  additional  enlisted 
specialties,  and  (c)  transfer  of  the  Army 
technology  to  develop  job  knowledge  tests 
in  four  Air  Force  enlisted  specialties. 


to  the  area  of  training  evaluation. 

Although  the  major  focus  of  these  accom¬ 
plishments  has  been  to  develop  a  perform¬ 
ance  measurement  system  that  enhances 
selection  and  classification  decision 
making,  the  JPM  technology  has  also  been 
applied  to  the  area  of  training  evalua¬ 
tion.  One  effort  that  demonstrates  this 
is  support  of  the  ATC  and  TAG  4-Level 
Training  Initiative  to  increase  the 
initial  weapon-specific  training  for  jet 
engine  mechanics.  The  JPM  technology  has 
been  used  to  develop  written  and  perform¬ 
ance  tests  to  evaluate  the  effect  of 
additional  resident  technical  training 
compared  to  current  field  training 
detachment  and  on-the-job  training.  In 
a  similar  way,  JPM  project  knowledge  and 
experience  are  being  relied  upon  by  HQ 
ATC  to  make  improvements  in  their 
instructor  evaluation  program. 

In  FY88,  a  "hands-on"  job  performance 
measurement  technique  will  be  developed, 
evaluated,  and  compared  with  other  meas¬ 
ures  of  on-the-job  performance.  A 
follow-on  to  this  effort  will  develop 
specifications  for  cost-effective  per¬ 
formance  measurement  technologies.  Data 
collected  by  using  these  techniques  will 
be  used  to  evaluate  training  and  selec¬ 
tion  procedures.  This  work  will  be  com¬ 
pleted  in  FY92. 

Contact:  Capt  Martin  Pellum 

AFHRL/IDE 

Brooks  AFB  TX  78235-5601 

Commercial:  (512)  536-2932 

AUTOVON:  240-2932 
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PERSONNEL  ASSESSMENT  SYSTEMS 


Training  decisions  in  the  Air  Force  have 
become  increasingly  critical  due  to  budg¬ 
etary  and  manpower  resource  constraints, 
historically,  the  Air  Force  has  only  been 
able  to  retrospectively  evaluate  the 
costs  and  benefits  of  different  training 
alternatives.  The  Training  Decisions 
System  (TDS)  will  promote  a  more  compre¬ 
hensive  and  integrated  approach  to  train¬ 
ing  programming  and  planning  by  providing 
Air  Force  manpower,  personnel,  and 
training  managers  with  a  computer-based, 
decision-making  aid  to  identify  and 
evaluate  training  alternatives  for  Air 
Force  specialties  (AFSs). 

Due  to  the  scope  and  complexity  of  Air 
Force  training,  the  challenges  faced  by 
the  Manpower,  Personnel,  and  Training 
(MPT)  communities  deal  with  deciding 
what  to  train  (training  content  deci¬ 
sions),  where  to  train  (appropriate  set¬ 
tings),  and  when  training  should  occur 
(at  various  points  throughout  an  airman's 
career).  Such  decisions  would  be  signi¬ 
ficantly  improved  by  using  a  computer- 
based  system  which  could  proactively 
analyze  and  provide  answers  to  "what  if" 
questions  such  as:  (a)  Which  tasks  in  a 
given  AFS  should  be  trained  together? 
(b)  Whfca  in  the  career  path  for  a  given 
AFS  should  specific  training  be  given? 


and  (c)  For  a  given  AFS,  in  what  training 
setting  (i.e..  Technical  Training  Center, 
OJT,  or  Field  Training  Detachment)  is  it 
most  cost  effective  to  train  specific 
groups  of  tasks? 

TDS  is  a  multiyear  R&D  effort,  consisting 
of  developing  three  basic  subsystems  and 
a  fourth  integrating  subsystem.  The 
first  subsystem,  called  the  Task  Charac¬ 
teristics  Subsystem,  identifies  groups 
of  tasks  (training  modules)  and  associat¬ 
ed  training  site  allocation  preference 
data.  These  modules  are  the  prime  build¬ 
ing  blocks  for  other  subsystems.  The 
second  subsystem,  called  the  Field  Utili¬ 
zation  Subsystem,  identifies  alternative 
training/personnel  assignment  patterns. 
The  third  subsystem,  the  Resource /Cost 
Subsystem  provides  costs  and  capacity 
indicators  for  every  task  training 
module  at  each  training  site.  These 
costs  and  capacity  functions  are  an 
important  input  to  the  TDS ' s  ability  to 
evaluate  the  costs  of  different  training 
alternatives.  The  fourth  subsystem  inte¬ 
grates  the  three  previously  described 
subsystems.  This  subsystem  consists  of 
optimization  software  and  an  interactive 
system,  which  permits  training  managers 
to  ask  a  variety  of  "what  if"  questions. 
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Capt  Jose  Hernandez  describes  the  Training  Decisions  System 
to  General  Randolph  (AFSC/CC),  September  1987. 


In  FY87,  TDS  accomplishments  included  the 
development  of  (a)  data  collection  meth¬ 
odologies,  (b)  procedures  to  determine 
current  and  alternative  airman  career 
patterns,  and  (c)  modeling  capabilities 
for  determining  effective  training  at 
minimum  cost.  In  addition,  a  training/ 
liaison  program  was  established  with  the 
users  to  further  the  transition  of  TDS. 

The  TDS  demonstrator  is  an  interim  micro¬ 
computer-based  system  designed  to  provide 
demonstrations  and  user  evaluations  of 
the  TDS.  The  goal  of  the  TDS  is  to  pro¬ 
vide  training  policymakers  with  advanced 
modeling  capabilities  to  aid  in  develop¬ 
ing  optimal,  overall  training  designs  for 
enlisted  Air  Force  career  ladders.  The 
TDS  demonstrator  provides  potential  TDS 
users  with  an  opportunity  to  interact 
with  and  query  the  system  to  see  how  im¬ 


proved,  cost-effective  training  decisions 
may  be  possible.  The  TDS  demonstrator 
uses  a  combination  of  actual  and  simulat¬ 
ed  data  to  clarify  the  advantages  that 
can  be  accrued  from  being  able  to  answer 
"what  if"  training  questions.  The  TDS 
demonstrator's  ability  to  model  such  im¬ 
portant  factors  as  cost,  assignment,  and 
training  capacity,  and  consider  them 
early  as  an  integral  part  of  the  Air 
Force  training  system  development  pro¬ 
cess,  demonstrates  how  the  Air  Force  may 
make  more  informed  decisions  by  using  the 
TDS.  The  TDS  demonstrator  is  very  user- 
friendly  with  its  color  displays,  help 
screens,  and  diagrammatic  representa¬ 
tions.  The  menu-driven  features  used  in 
the  TDS  demonstrator  allow  a  manager  with 
little  or  no  computer  background  to  see 
how  the  TDS  would  help  develop  the  most 
cost-effective  training  possible  while 
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considering  information  about  job  tasks, 
assignment  patterns,  and  managers'  pref¬ 
erences. 

Contact ;  Maj  Daniel  L.  Collins 
AFHRL/IDE 

Brooks  AFB  TX  78235-5601 
Commercial:  (512)  536-3047 
AUTOVON :  240-3047 


INTELLIGENT  SYSTEMS  BRANCH 

The  objective  of  the  Intelligent  Systems 
Branch  is  to  perform  R&D  that  improves 
the  effectiveness  of  Air  Force  training 
through  the  application  of  Artificial 
Intelligence  (AI)  to  advanced  training 
systems.  Three  AI  R&D  thrusts  provide  a 
means  for  investigating  scientific 
issues  surrounding  Intelligent  Tutoring 
Systems  (IIS):  tools,  tutors,  and  test¬ 
beds.  Tools  are  used  to  acquire  and 
represent  knowledge  to  aid  in  the  devel¬ 


opment  of  ITS.  The  tutor  thrust  is  con¬ 
cerned  with  designing  and  building  proto¬ 
type  training  systems  to  meet  the  user's 
needs.  These  systems  are  then  used  as 
testbeds  for  evaluating  and  assessing  the 
cost  and  training  effectiveness  of  ITS. 
The  long-term  goal  is  to  build  the  best 
in  ITS  for  the  Air  Force  2000  complex, 
high-tech  jobs. 

One  cornerstone  effort  is  the  joint- 
Service  project  for  a  knowledge  acquisi¬ 
tion  system  and  intelligent  authoring 
aids.  The  purpose  of  this  effort  is  to 
develop  an  ITS  shell  for  joint-Service 
domains.  Also,  the  intelligent  authoring 
aids  will  allow  an  instructor,  without 
computer  experience,  to  develop  a  course 
of  instruction  in  an  automated  tutoring 
situation.  Currently,  the  branch  is 
participating  in  a  DOD-funded  R&D  project 
with  the  Army  Research  Institute  (ARI) 
to  determine  the  benefits  of  implementing 
ITS  within  the  space  training  environ- 


Artificial  intelligence  R&D  will  enhance  training  and  instruction. 


raent.  An  Associate  Training  Instruc¬ 
tional  Environment  (ATIE)  is  a  generic 
testbed  for  in-house  R&D  as  the  Branch 
looks  toward  the  development  of  multiple 
domain  intelligent  training  systems.  For 
example,  an  in-house  R&D  effort  on  orbi¬ 
tal  mechanics  has  been  developed  for  the 
Undergraduate  Space  Training  School  at 
Lowry  AFB,  CO.  Major  interest  in  such  a 
project  comes  from  HQ  Space  Command  and 
HQ  Air  Training  Command.  For  the  long 
term,  a  four-year  project  called  Intel¬ 
ligent  Computer-Assisted  Training  Test¬ 
beds  includes  our  more  applied  expert 
systems  and  ITS  R&D  projects. 

Intelligent  Computer-Assisted  Training 
Testbeds 

The  approach  adopted  by  this  project  is 
to  acquire  a  library  of  modular  software 
to  enable  rapid  development  of  Intelli¬ 
gent  Computer-Assisted  Training.  The 
approach  reduces  time  and  expense  for 


developing  instruction  by  providing 
instructional  developers  with  kernel 
modules  that  can  be  adapted  to  specific 
instruction,  and  has  the  additional 
advantage  of  allowing  the  software  to  be 
easily  updated  to  keep  pace  with  changing 
technology.  The  project  will  then  use 
this  rapid  development  capability  as  a 
testbed  within  which  to  evaluate  various 
instructional  approaches  in  a  range  of 
Air  Force  occupations.  Finally,  the 
project  will  demonstrate  the  feasibility 
of  developing  cost-effective  and  instruc- 
tionally  effective  intelligent  computer- 
assisted  training.  The  prototype  soft¬ 
ware  for  this  project  is  being  developed 
under  a  joint-Service  agreement  with  the 
Office  of  Naval  Research. 

Contact;  Dr.  Wes  Regian 
AFHRL/IDI 

Brooks  AFB  TX  78235-5601 
Commercial:  (512)  536-2981 
AUTOVON:  240-2981 


The  goal  of  artificial  intelligence  in  training  is 
to  deploy  high  quality,  individualized  instruction. 


The  Intelligent  Tutor  for  Space  Operations  program  will  demonstrate  and  evaluate 
Intelligen*-  Training  System  technology  in  an  Air  Force  training  environment. 


Intelligent  Tutor  for  Space  Operations 

The  Intelligent  Tutor  for  Space  Opera¬ 
tions  (ITSO)  is  an  AFHRL-led  project 
sponsored  by  the  Joint-Services  Committee 
on  Manpower  and  Training  Technology 
Development  (JS/MTTD) .  The  objective  of 
ITSO  is  to  design,  implement,  and  evalu¬ 
ate  a  prototype  intelligent  tutoring  sys¬ 
tem  (ITS)  in  a  space  operations  domain. 
ITSO  will  be  demonstrated  and  evaluated 
at  the  Space  Training  Squadron  located 
at  Lowry  AFB  in  Denver,  CO.  This  effort 
represents  an  excellent  opportunity  to 
develop,  demonstrate,  and  evaluate  an 
ITS  in  a  real  training  environment.  In 
addition  to  developing  an  ITS  for  a 


space  training  domain,  major  emphasis 
will  focus  on  cost  and  training 
effectiveness  issues.  This  project  will 
produce  a  prototype  ITS,  a  set  of  func¬ 
tional  specifications  to  include  a  meth¬ 
odology  report,  training  effectiveness 
data,  ITS  development  cost  report,  and 
lessons  learned  from  the  ITSO  project. 

Contact;  Capt  Kevin  B.  Kline 
AFHRL/IDI 

Brooks  AFB,  TX  78235-5601 
Commercial:  (512)  536-2981 

AUTOVON:  240-2981 
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Knowledge  Acquisition/Intelligent  Author¬ 
ing  Aids 

This  is  a  joint-Service  initiative  to 
design  and  develop  intelligent  computer- 
assisted  instructional  tools  and  tech¬ 
niques  for  system  users  (instructors  and 
students).  The  project  is  in  the  third 
year  of  a  four-year  R&D  effort,  and  will 
allow  each  of  the  three  Services  (Air 
Force,  Navy,  and  Army)  to  more  efficient¬ 
ly  train  their  members  on  a  wide  variety 
of  tasks.  Probable  domains  include  space 


operations  and  space  vehicle  maintenance. 
In  the  past  year,  symbolic  and  natural 
language  interfaces  have  been  developed. 
These  attributes  allow  the  instructors 
to  develop  materials  which  will  be  used 
by  the  system  as  it  delivers  intelligent, 
automated  instruction. 

Contact:  Lt  Col  Hugh  Burns 
AFHRL/IDI 

Brooks  AFB  TX  78235-5601 
Commercial:  (512)  536-2981 
AUTOVON:  240-2981 


The  Knowledge  Acquisition/Intelligent  Authoring  Aids  system  is  a 
joint  Air  Force,  Army,  and  Navy  effort  to  develop  intelligent 
programming  tools  for  building  Intelligent  Tutoring  Systems. 
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Maintainer's  Associate  Training  Instruc¬ 
tional  Environment  (MATIE  I/II) 

MATIE  I  was  conpleted  during  FY87.  A 
previously  developed  expert  system  was 
enhanced  to  permit  the  development  of  an 
Intelligent  Tutorial  System  (ITS)  based 
upon  the  maintenance  knowledge  domain. 
The  objective  of  MATIE  II  is  to  implement 
and  demonstrate  the  intelligent  system 
based  upon  the  ITS  framework  from  MATIE 
I  without  the  specific  maintenance  knowl¬ 
edge.  A  subobjective  is  to  design  a  ba¬ 
sic  architecture  called  Associate  Train¬ 
ing  Instructional  Environment  (ATIE). 
This  would  allow  for  the  rapid  develop¬ 
ment  of  an  ITS  for  many  domains. 

Contact:  Capt  Kevin  B.  Kline 

AFHRL/IDI 

Brooks  AFB  TX  78235-5601 
Commercial:  (512)  536-2981 

AUTOVON:  240-2981 


Intelligent  Training  Worlds 

The  Intelligent  Training  Worlds  Prog’''m 
consists  of  research  in  alternative  in¬ 
structional  approaches  within  ITS.  In 
1987,  the  orbital  mechanics  tutor  (OMT) 
was  completed.  This  intelligent  tutor 
teaches  the  satellite  ground  tracks  por¬ 
tion  of  the  orbital  mechanics  course  at 
the  Undergraduate  Space  Training  School, 
Lowry  AFB,  CO  and  features  a  graphics¬ 
intensive  simulation  of  parameter- 
defined  satellite  ground  tracks.  The 
tutor  has  received  the  acclaim  of  Under¬ 
graduate  Space  Training  School  instruc¬ 
tors.  In  1988,  the  OMT  will  be  imple¬ 
mented  on  Undergraduate  Space  Training 
School  hardware  for  course  delivery. 

Contact:  Dr.  Wes  Regian 

AFHRL/IDI 

Brooks  AFB  TX  78235-5601 
Commercial:  (512)  536-2981 

AUTOVON:  240-2981 


The  orbital  mechanics  tutor  offers  very  high- 
resolution  graphics  and  a  user-friendly  interface. 
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ON-THE-JOB  TRAINING  BRANCH 

The  On-the-Job  Training  Branch  is  located 
at  Bergstrom  AFB,  TX,  a  Tactical  Air 
Command  installation.  Its  mission  is  to 
develop  a  prototype  system  that  can  be 
used  in  the  field  to  enable  commanders 
and  supervisors  to  conduct,  manage,  and 
evaluate  on-the-job  training  in  support 
of  mission  effectiveness.  The  Branch  is 
located  at  Bergstrom  AFB  so  that  the 
prototype  system  can  be  developed,  test¬ 
ed,  and  evaluated  in  the  field. 

Advanced  On-the-job  Training  System 

In  the  mid-1970's,  functional  management 
inspections,  senior  management  reviews, 
and  OJT  studies  and  analyses  have  identi¬ 
fied  numerous  operational  deficiencies 
of  job  site  training.  While  diligent 
effort  has  produced  some  improvement  in 


OJT,  major  system  deficiencies  have  con¬ 
tinued  to  tax  OJT  capability,  resulting 
in  minimally  effective  job  site  training. 
In  addition,  new  weapon  systems,  skills 
compression,  and  shortages  of  skilled 
technicians  all  increase  the  need  for  a 
system  that  is  automated  and  capable  of 
handling  the  Air  Force's  OJT  needs.  Con¬ 
sequently,  the  Air  Staff  directed  an  R&D 
effort  to  develop  a  prototype  state-of- 
the-art  Air  Force  OJT  system. 

The  project  objective  is  to  design,  de¬ 
velop,  demonstrate,  test,  and  evaluate  a 
prototype  Advanced  On-the-job  Training 
System  (AOTS)  for  the  Air  Force  that  in¬ 
tegrates  and  effectively  manages,  evalu¬ 
ates,  and  automates  job  site  training. 
AOTS  will  provide  the  Air  Force  with 
capabilities  to  improve  the  methods  for 
conducting  and  managing  OJT,  thereby 
making  OJT  more  responsive  to  mission 
requirements . 
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The  AOTS  prototype  consists  of  five  major 
interrelated  subsystems  that  integrate 
Air  Force  training  management,  evalua¬ 
tion,  training  development  and  delivery, 
computer  support,  and  personnel  and  lo¬ 
gistics  subsystems.  The  management  sub¬ 
system  improves  OJT  management  tools  and 
procedures  at  all  levels  of  the  OJT  pro¬ 
cess.  The  evaluation  subsystem  provides 
evaluation  materials,  quality  contiol 
procedures,  and  data  for  assessing  OJT 
capacity  and  effectiveness.  The  training 
development  and  delivery  subsystem  pro¬ 
vides  AOTS  with  the  additional  capability 
to  develop  instructional  materials  and 
manage  their  delivery  at  the  job  site. 
The  computer  support  subsystem  applies 
state-of-the-art  computer  technology  to 
support  the  management  and  evaluation  of 
job  site  training.  The  personnel  and 
support  subsystem  specifies  the  qualita¬ 
tive  and  quantitative  personnel  require¬ 
ments  of  an  operational  AOTS,  as  well  as 
the  requirements  associated  with  main¬ 
tenance,  reliability,  logistics,  and 
transition  of  the  system. 

The  AOTS  prototype  development  is  a  four- 
year,  three-phased  effort.  The  design 
phase  fully  details  AOTS  specifications 
and  provides  the  design  documents  for  the 
development  phase.  Phase  II,  the  devel¬ 
opment  phase,  is  the  time  during  which 
AOTS  will  be  built.  The  final  phase. 


System  Level  Test  and  Evaluation  (SLT&E) 
is  12  months  in  duration,  allowing  the 
Air  Staff  and  major  commands  to  assess 
AOTS  in  the  operaLional  eaviionment. 

In  addition  to  the  evaluation  data  re¬ 
sulting  from  SLT&E,  the  evaluation  plan 
calls  for  a  side-by-side  comparison  of 
AOTS  and  current  OJT  system  work  centers. 
State-of-the-art  technology  will  be  sys¬ 
tematically  applied  to  OJT  conducted  in 
designated  work  centers  of  TAC's  67th 
Tactical  Reconnaissance  Wing,  the  147th 
Fighter  Interception  Group  of  the  Texas 
Air  National  Guard  (Ellington  ANGB) ,  and 
the  924th  Tactical  Fighter  Group  of  the 
Air  Force  Reserve.  The  enlisted  job 
specialties  used  to  develop  the  prototype 
system  include:  426X2,  Jet  Engine  Mechan¬ 
ic;  732X0,  Personnel;  431X2C,  Tactical 
Aircraft  Maintenance;  and  811XX,  Security 
Police.  AFHRL  has  20  senior  NCOs  assign¬ 
ed  to  assist  in  the  development  of  in¬ 
structional  and  evaluation  materials  and 
to  ensure  the  AOTS  will  work  in  the 
operational  environment. 


The  AOTS  design  phase  was  completed  in 
May  1986  and  the  first  set  of  software 
products  containing  training  development 
toois  was  tested  and  delivered  in  June 
1987.  A  contract  modification  to  add  the 
Training  Development  and  Delivery  sub¬ 
system  to  the  AOTS  contract  was  negoti¬ 
ated  and  work  began  in  September  1987. 
Initial  site  surveys  for  the  SLT&E  at 
Bergstrom  AFB  and  Ellington  ANGB  have 
been  conducted.  The  AOTS  team  continues 
to  work  with  the  developers  of  other 
functional  area  automated  systems  to  be 
aware  and  plan  for  system  integration 
activities  during  field  implementation. 
Planning  for  the  SLT&E  was  started  in 
January  1987;  baseline  data  collection 
was  initiated  in  October  1987,  and  will 
be  continued  until  start  of  the  test  and 
evaluation  period.  The  AOTS  Senior  NCO 
Instructional  Systems  Team  has  identified 
training  requirements  for  the  selected 
work  centers,  conducted  task  analyses, 
and  developed  behavioral  objectives,  and 
is  developing  training  and  evaluation 
materials  in  accordance  with  the  Air 
Force  Instructional  Systems  Development 
process.  The  AOTS  software  is  scheduled 
to  be  completed  in  July  1989,  and  the 
SLT&E  will  take  place  from  1  August  1988 
to  31  August  1989. 


Transition  planning  with  the  Air  Staff 
(HQ  USAF/DPPES),  and  the  Human  Systems 
Division  of  Air  Force  Systems  Command  is 
ongoing  and  will  continue  throughout  the 
project.  A  fully  coordinated  and  signed 
technology  transition  plan  is  available 
for  AOTS.  Three  levels  of  transition  are 
required.  AOTS  has  been  designed  to 
provide  and  emphasize  the  transition  of 
incremental  products,  payoffs,  and  imple¬ 
mentation  as  the  work  unfolds.  Examples 
of  initial  products  include:  training 
requirements  definition  processes /lists , 
task  proficiency  evaluation  procedures, 
training  resources  identification/  sched¬ 
uling  procedures,  and  automated  training 
records.  Incremental  products  will  be 
provided  to  the  Air  Staff  for  evaluation 
and  implementation  Air  Force-wide.  The 
model  AOTS  at  Bergstrom  AFB,  Texas  is  to 
be  transitioned  to  the  Tactical  Air  Com¬ 
mand  upon  completion  of  the  prototype. 
Finally,  AOTS  transition  and  implementa¬ 
tion  plans  are  to  be  provided  to  the  Air 
Staff  for  deployment  of  AOTS  throughout 
the  Air  Force. 

Contact:  Maj  Jack  Blackhurst 

AFHRL/ID-OLAK 

Bergstrom  AFB  TX  78743-5000 

Commercial:  (512)  369-2669 

AUTOVON:  685-2669 
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MANPOWER  AND  PERSONNEL  DIVISION 


The  Manpower  and  Personnel  Division  (MO) 
employs  approximately  80  scientific, 
technical,  and  support  personnel  and  has 
an  annual  budget  of  approximately  $7 
million  to  conduct  research  and  develop¬ 
ment  (R&D)  in  the  areas  of  manpower,  per¬ 
sonnel,  and  training.  The  entire  Divi¬ 
sion  is  located  at  Brooks  AFB,  except  for 
approximately  10  people  who  operate  an 
experimental  testing  program  at  Lackland 
AFB.  The  Division's  work  can  be  divided 
into  three  main  thrusts:  (a)  measuring 
individuals'  aptitudes  and  abilities, 

(b)  determining  job  requirements,  and 

(c)  developing  techniques  for  better 
integrating  people  and  jobs.  The  Divi¬ 
sion  is  organized  into  the  following  four 
branches;  (a)  Force  Acquisition  (MOA); 

(b)  Cognitive  Skills  Assessment  (MOE); 

(c)  Manpower,  Personnel,  and  Training 
Technology  (MOD);  and  (d)  Force  Manage¬ 
ment  Systems  (MOM).  A  Program  Support 
Office  (mop)  assists  the  task  scientists 
in  contracting,  acquisition,  funding, 
and  other  program  control  activities. 


Most  of  the  scientists  in  the  Division 
are  trained  in  the  behavioral  sciences, 
including  psychology  and  human  factors; 
computer  science,  mathematics,  and  oper¬ 
ations  research  are  also  strongly  repre¬ 
sented.  Seventy  percent  of  the  Divi¬ 
sion's  scientists  have  advanced  degrees 
with  nearly  one-third  at  the  doctoral 
level . 

The  Division  continues  to  be  active  in 
the  joint-Service  and  international 
arenas.  The  Armed  Services  Vocational 
Aptitude  Battery  (ASVAB) ,  used  by  all 
four  Services  for  the  selection  and  clas¬ 
sification  of  all  new  enlisted  members, 
is  developed  and  maintained  by  MOA.  The 
pilot  selection  technology  developed  by 
MOE  is  now  being  used  operationally  by 
the  Air  National  Guard  and  is  being  eval¬ 
uated  by  NATO  and  Australia,  as  well  as 
the  U.S.  Army  and  Navy  and  Air  Training 
Command.  While  the  division  has  always 
maintained  close  ties  with  Air  Training 
Command  and  the  Air  Force  .  ilitary 
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Personnel  Center,  it  is  also  involved 
with  other  Air  Force  operating  commands. 
The  ongoing  field  test  of  a  new  Basic  Job 
bkills  tutor  has  involved  Tactical  Air 
Command  (Langley,  Eglin,  and  Holloman 
AFBs).  Also,  a  methodology  for  enhancing 
productivity  has  been  briefed  to  Pacific 
Air  Forces  and  the  Air  Force  Office  of 
Security  Police. 

The  Manpower  and  Personnel  Division  has 
a  long  history  of  valuable  contributions 
to  personnel  management  within  the  Air 
Force.  In  addition  to  ASVAB,  the  Divi¬ 
sion  also  developed  the  Air  Force  Officer 
Qualifying  Test  (AFOQT),  the  Weighted 
Airman  Promotion  System  (WAPS),  and  the 
person-job  match  program  used  in  the 
initial  classification  of  all  new  Air 
Force  recruits,  and  was  a  pioneer  in  the 
area  of  job  analysis.  During  FY87,  the 
Division  delivered  to  HQ  ATC/Technical 
Training  a  new  classification  algorithm 
which  will  be  used  to  better  assign  basic 
trainees  to  their  first  career  field. 
During  the  year,  the  Division  also  hosted 
a  major  conference  on  Manpower,  Person¬ 
nel,  and  Training  (MPT)  considerations 
in  the  Weapon  System  Acquisition  Process 
(WSAP),  an  issue  that  is  receiving 
increasing  attention  throughout  DOD  and 
the  Congress  and  one  that  will  demand  a 
major  R&D  effort  from  the  Division  (and 
all  of  AFHRL)  in  the  future. 


FORCE  ACQUISITION  BRANCH 

The  Force  Acquisition  Branch  conducts  R&D 
on  individual  differences;  develops  meas¬ 
uring  techniques  and  means  for  inclusion 
of  these  techniques  into  the  operational 
selection/assignment  system;  conducts 
selection  system  research  for  Air  Force 
military  personnel  by  development  and 
long-term  validation  of  selection  instru¬ 
ments  and  special-purpose  aptitude  bat¬ 
teries;  accomplishes  R&D  in  support  of  a 
tri-Service  aptitude  battery;  prepares 
camera-ready  copies  of  operational  tests; 
and  investigates  the  utility  of  new 
psychometric  techniques. 
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Armed  Services  Vocational  Aptitude 
Battery  (ASVAB) 

The  ASVAB  is  used  as  the  primary  enlist¬ 
ment  selection  and  classification  test 
for  the  United  States  Armed  Services. 
The  ASVAB  is  administered  to  approximate¬ 
ly  one  million  applicants  for  the  U.S. 
military  in  the  operational  testing  pro¬ 
gram,  as  well  as  another  one  million  high 
school  students  in  the  DOD  Student  Test¬ 
ing  Program.  The  Laboratory  is  the  lead 
Service  personnel  R&D  organization  sup¬ 
porting  the  joint-Service  and  DOD  pro¬ 
grams.  AFHRL  not  only  develops  the  ASVAB 
forms  for  both  programs,  but  also  accom¬ 
plishes  the  R&D  necessary  to  support  each 
testing  system.  Recently,  AFHRL  complet¬ 
ed  the  operational  calibration  and  the 
Initial  Operational  Test  and  Evaluation 
of  the  next  generation  of  ASVAB  forms 
(Forms  15,  16,  and  17)  due  for  implemen¬ 
tation  1  October  1988.  Additionally, 
AFHRL  completed  the  construction  and 
operational  calibration  of  four  new 
versions  of  the  ASVAB  to  be  used  in  the 
DOD  Student  Testing  Program. 

During  the  past  year,  AFHRL  began  devel¬ 
opment  of  military  testing  archives,  and 
work  was  also  begun  on  a  revision  to  the 
High  School  Counselor's  Manual  that  will 
incorporate  additional  information  on  the 
ASVAB  that  has  been  published  since  the 
previous  1984  edition.  Work  was  complet¬ 
ed  on  the  Civilian  Occupational  Validity 
effort,  as  well  as  an  item-level  bias 
project  for  ASVAB  Form  14  used  in  the 
DOD  Student  Testing  Program.  A  number 
of  analytic  studies  of  the  ASVAB  were 
completed  dealing  with  alternate  forms 
reliability  and  operating  characteristics 
of  previous  forms  of  the  paper-and-pencil 
ASVAB,  as  well  as  an  R&D  effort  on  Multi¬ 
dimensional  Item  Response  Theory  models. 

For  the  future,  the  Laboratory  will  be 
looking  to  further  develop  indices  of 
"appropriateness"  measurement  by  opera¬ 
tionally  testing  these  measures,  using 
state-of-the-art  psychometric  advances 
in  order  to  detect  compromise  and  true 
and  deliberate  failures. 


We  will  also  look  to  complete  a  large- 
scale  factor  reference  analysis  of  the 
ASVAB  and  begin  development  of  the 
follow-on  forms  of  the  ASVAB  for 
implementation  in  1992. 

Contact;  Maj  John  Welsh 
AFHRL/MOAE 

Brooks  AFB  TX  78235-5601 
Commercial:  (512)  536-3256 

AUTOVON:  240-3256 


Air  Force  Officer  Qualifying  Test  (AFOQT) 

The  Air  Force  Human  Resources  Laboratory 
(AFHRL)  has  the  primary  responsibility 
for  the  development  of  the  AFOQT  and  R&D 
supporting  its  use.  The  test  is  the 
principal  aptitude  measure  used  in  the 
selection  of  officer  candidates  for  the 
Air  Force  Reserve  Officer  Training  Corps 
(AFROTC)  and  Officer  Training  School 
(OTS)  programs.  The  AFOQT  is  also  used 
to  classify  commissionees  for  further 
training  in  technical  fields.  Undergrad¬ 
uate  Pilot  Training  (UPT),  and  Undergrad¬ 
uate  Navigator  Training  (UNT).  Approxi¬ 
mately  35,000  college  students  and  grad¬ 
uates  are  administered  the  AFOQT  each 
year.  In  1987,  AFOQT  test  results  were 
used  in  selection  and  classification 
decisions  for  about  61  percent  of  the 
pilot  selectees,  87  percent  of  the  navi¬ 
gator  selectees,  and  over  90  percent  of 
the  nonrated  officer  job  assignments. 

The  primary  benefit  of  the  AFOQT  is  an 
enhanced  Air  Force  capability  to  identi¬ 
fy,  from  the  large  pool  of  civilian 
applicants,  those  candidates  with  a  high 
likelihood  for  success  as  Air  Force 
officers.  Payoffs  include  reduced 
attrition  in  OTS,  AFROTC,  technical 
schools,  UPT,  and  UNT.  With  the  imple¬ 
mentation  of  alternate  AFOQT  Forms  (Pl 
and  P2)  this  year,  new  benefits  were 
realized.  Applicant  retesting  capability 
was  improved;  risk  of  test  compromise  was 
also  reduced.  Should  one  test  version 
be  compromised,  the  second  version  can 
continue  to  be  used  exclusively  with  no 
interruption  of  operational  testing. 
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The  most  important  R&D  activity  in  this 
program  is  the  constructing  and  transi¬ 
tioning  of  new  versions  of  the  AFOQT  to 
the  Air  Force  Military  Personnel  Center 
(AFMPC),  the  agency  responsible  for  the 
operational  testing  program.  Other  crit¬ 
ical  R&D  tasks  are  continual  monitoring 
of  test  performance  in  the  operational 
setting  and  test  validation  against 
selection  system  and  training  criteria. 

During  FY87,  MOAO  completed  the  analysis 
and  documentation  of  a  Forms  P  preimple¬ 
mentation  project.  Products  delivered 
to  AFMPC  included  final  copies  of  Forms 
P  test  booklets,  an  administration  man¬ 
ual,  scoring  keys,  and  interim  conversion 
tables.  Concurrent  with  Forms  P  imple¬ 
mentation  in  June  1987,  an  Initial  Oper¬ 
ational  Test  and  Evaluation  (lOT&E)  was 
begun.  One  goal  of  the  lOT&E  is  to  ver¬ 
ify  the  raw  score  to  percentile  conver¬ 
sion  tables  developed  from  the  preimple¬ 
mentation  project.  Another  major  product 
which  was  developed  and  transitioned  re¬ 
cently  was  the  AFOQT  Information  Pamphlet 
(AFPT  997,  01  January  1987). 

An  ongoing  major  effort  of  MOAO  is  the 
development  of  item  pools  for  each  of 
the  current  AFOQT  content  areas  and  for 
13  new  subtests.  These  will  support 
development  of  the  Forms  Q.  AFHRL  is 
also  continuing  R&D  in  support  of  Forms 
P.  This  includes  assessment  of  test 
performance,  validation  with  OTS  and 
AFROTC  selection  systems  and  training 
outcomes,  validation  against  aircrew 
training  criteria,  and  generation  of  an 
AFOQT  "quick  score"  for  recruiters. 
Plans  are  also  underway  to  identify, 
develop,  and  validate  new  predictors  of 
officer  success  outside  the  cognitive 
domain.  Of  special  interest  are 
managerial  and  leadership  abilities. 

Contact:  Lt  Col  David  E.  Brown 

AFHRL/MOAO 

Brooks  AFB  TX  78235-5601 

Commercial:  (512)  536-3256 
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MANPOWER,  PERSONNEL,  AND 
TRAINING  TECHNOLOGY  BRANCH 

The  Manpower,  Personnel,  and  Training 
Technology  Branch  develops  methods  for 
estimating  manpower,  personnel,  and 
training  needs  of  new  and  modified 
weapon  systems.  It  develops  methods  for 
collecting,  analyzing,  and  reporting 
data  describing  jobs  and  organizations. 
It  develops  methods/procedures  for 
determining  the  mental,  physical,  and 
educational  requirements  of  jobs.  It 
also  develops  methods  for  estimating  the 
availability  of  military  personnel,  and 
methods  for  estimating  the  ability  of 
the  Air  Force  to  attract  personnel  from 
the  civilian  labor  pool. 

Occupational  Measurement  Technology 

The  principal  occupational  analysis  tech¬ 
nology  in  the  Air  Force  is  the  Comprehen¬ 
sive  Occupational  Data  Analysis  Programs 
(CODAP)  software  system,  which  was  devel¬ 
oped  in  the  early  1960s  to  resolve  a 
variety  of  manpower,  personnel,  and 
training  (MPT)  management  questions. 
Current  CODAP  development  efforts  (based 
on  the  new  ASCII  FORTRAN  Standard)  will 
result  in  increased  system  capabilities 
and  advanced  analytical  features  and 
technologies  such  as  automated  job-type 
selection  procedures,  profile  analysis 
techniques,  and  non-hierarchical  and 
semantic  clustering  capabilities.  These 
enhancements  will  support  important 
applications  efforts  by  the  USAF  Occupa¬ 
tional  Measurement  Center  (USAFOMC),  the 
primary  user  of  the  ASCII  CODAP  software, 
as  well  as  numerous  MPT-related  R&D 
activities  being  conducted  by  AFHRL. 

Included  in  the  enhanced  ASCII  CODAP 
software  are  techniques  to  automate  the 
Weighted  Airman  Promotion  System  (WAPS) 
Test  Outline  development  procedures.  As 
part  of  the  WAPS,  airmen  eligible  for 
promotion  to  the  grades  E-5,  E-6,  and 
E-7  are  required  to  take  a  Specialty 
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ADVANCED  DEVELOPMENT  OF  CODAP 


Knowledge  Test  (SKT),  designed  to  test 
their  knowledge  of  their  career  field. 
Automated  procedures  have  been  developed 
to  enhance  the  validity  of  the  Air  Force 
test  development  procedures  by  providing 
a  more  direct  link  between  job  content 
and  promotion  test  content.  During  the 
process,  direct  measures  of  testing  im¬ 
portance  are  collected  from  senior  level 
noncommissioned  officers  on  selected 
sets  of  job  inventory  tasks.  CODAP  soft¬ 
ware  is  used  to  process  these  ratings  and 
to  produce  a  recommended  number  of  SKT 
items  to  be  written  for  task  sets  within 
major  duty  areas.  Test  developers  use 
the  individual  task  performance  state¬ 
ments  as  aids  in  writing  SKT  items. 

The  final  product  of  the  CODAP  effort 
will  be  a  prototype  occupational  measure¬ 
ment  software  system  which  will  be  more 
responsive  to  the  increasingly  sophisti¬ 
cated  methods  and  procedures  required  by 
Air  Force  occupational  researchers 


and  analysts.  As  the  official  DOD 
methodology  for  conducting  job  analyses, 
the  ASCII  CODAP  system  should  transition 
to  the  other  branches  of  the  Armed 
Services  within  the  next  year. 
Additionally,  AFHRL  will  continue  its 
involvement  with  Federal  and  state 
agencies,  county-level  governments,  and 
universities  as  they  obtain  and  use 
CODAP  for  their  occupational  analysis 
needs . 

The  graphic  above  depicts  various  aspects 
of  the  ongoing  development  of  the  CODAP 
system.  The  "arrowpoints"  running  from 
top  to  bottom  focus  on  the  ongoing  effort 
to  update  and  redesign  the  CODAP  software 
to  arrive  at  an  advanced  prototype  soft¬ 
ware  system  for  occupational  analysis  (to 
be  completed  by  September  1988).  The 
prototype  system  will  facilitate  a  large- 
scale  expansion  of  the  CODAP  system,  as 
shown  in  the  large  circle  surrounding 
it,  in  terms  of  augmenting  existing 
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programs,  developing  new  programs,  ex¬ 
tracting  and  modifying  non-CODAP  software 
for  incorporation  into  CODAP,  and  devel¬ 
oping  interfaces  with  AFHRL  software 
library  programs.  Simultaneously,  OT&E 
of  the  new,  modified,  and  interfaced 
software  will  be  conducted,  not  only  to 
ensure  that  the  software  is  working  prop¬ 
erly  for  all  types  of  CODAP  data  sets, 
but  also  to  establish  applicability 


criteria.  The  final  output  will  be  an 
advanced  operational  CODAP  system  (to  be 
completed  by  September  1992). 

Contact:  Mr.  William  J.  Phalen 

ILt  Kathleen  M.  Longmire 
AFHRL/MODM 
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AUTOVON:  240-3551 


OCCUPATIONAL  MEASURgMEMT  TECHNOLOGY 


ONGOING  AND  FUTURE  RESEARCH 

CURRENT  AND  NEW  APPLICATIONS 

•TRAINING  DECISIONS  SYSTEM (TDS) 

•  CLASSIFICATION  STRUCTURES 

•  TRAINING  REQUIREMENTS 

®  i5AbJ.(J  JOb  SKILLS 

•  PERSONNEL  UTILIZATION 

•  PERFORMANCE  MEASUREMENT 

•  MANAGEMENT  ANALYSES 

•  ADVANCED  ON-THE-JOB  TRAINING 

•TASK  ANALYSES  FOR  ISD 

SYSTEM  (AOTS) 

•  OCCUPATIONAL  RESEARCH  DATA 

•  WAPS  TEST  DEVELOPMENT 

BANK 
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Manpower,  Personnel,  and  Training 
Integration  Research 

At  a  time  when  emerging  weapon  systems 
are  requiring  more  highly  skilled  person¬ 
nel,  significant  manpower  authorization 
shortages  and  increasing  industry  compe¬ 
tition  for  personnel  with  high  technical 
skills  mandate  that  manpower,  personnel, 
and  training  (MPT)  requirements  be  eval¬ 
uated  early  and  as  part  of  the  new  weapon 
system  design  tradeoff  decision  process. 
Three  problems  hinder  this  effort.  First, 
MPT  requirements  have  little  impact  on 
design  decisions.  Second,  fielding  of 
new  or  modified  weapon  systems  is  sub- 
optim.al  because  the  acquisition  process 
does  not  provide  detailed  information 
sufficiently  early  to  permit  personnel 
and  training  pipelines  to  be  properly 
established  before  delivery.  Finally, 
for  existing  weapon  systems,  there  are 
insufficient  data  base  and  software 
mechanisms  for  the  MPT  managers  to  con¬ 


sider  total  system  impact  when  making 
specific  decisions  in  their  spheres  of 
influence . 

The  MPT  Integration  Research  Project  will 
develop  technologies  to  solve  each  of  the 
three  problems  stated  above.  Both  in- 
house  and  contract  R&D  will  be  used  to 
modify  existing  and  develop  new  MPT  fore¬ 
casting  and  integrating  technologies. 
Specifically,  extensive  occupational 
analysis,  task  benchmarking,  aptitude  and 
training  requirement  forecasting,  and  job 
and  force  modeling  technologies  will  be 
modified  or  developed  to  fill  identified 
technology  gaps.  Interim  products  will 
be  transitioned  to  MPT  users  for  imple¬ 
mentation  as  these  products  are  complet¬ 
ed.  Technologies  now  nearing  completion 
will  aid  the  integration  of  MPT 
decisions  for  existing  weapon  systems. 

Three  efforts  illustrate  our  work  in  the 
MPT  arena  during  1987;  conducting  an  Air 
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Manpower,  personnel,  and  training  requirements  must 
be  evaluated  early  in  weapon  system  design  process. 


Force-wide  MPT  conference,  completion  of 
a  Logistic  Support  Analysis-Instructional 
Systems  Development  (LSA-ISD)  interface 
system  for  the  C-17,  and  progress  in  the 
area  of  weapon-system-specific  job  analy¬ 
sis.  Each  of  these  efforts  warrants 
further  comment. 

First,  AFHRL  held  an  MPT  conference  on 
11-13  May  1987,  which  brought  together 
the  acquisition,  design,  development,  and 
user  communities  with  the  manpower,  per¬ 
sonnel,  and  training  communities  so  that 
they  could  jointly  determine  what  tools 
and  technologies  are  available  and  needed 
to  successfully  integrate  MPT  decisions 
into  the  Weapon  System  Acquisition  Pro¬ 


cess  (WSAP).  The  approximately  200 
attendees  included  representatives  from 
user  and  support  major  commands.  Air 
Staff,  the  System  Program  Offices  (SPOs), 
contractors,  the  R&D  community,  etc.  The 
conference  provided  interaction  opportun¬ 
ities  for  key  MPT  players  to  establish  a 
common  frame  of  reference,  to  bridge 
communication  gaps,  and  to  establish 
policy  and  R&D  issues  for  future  MPT 
program  direction.  The  conference  pro¬ 
vided  the  participants  with  a  unique 
opportunity  for  interaction  and  a  chance 
to  surface  critical  issues  and  problems. 
AFHRL  will  be  able  to  develop  a  compre¬ 
hensive  R&D  plan  aimed  at  providing  a 
better  coordinated  MPT  decision  process 
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to  be  integrated  into  the  WSAP.  All 
agencies  will  be  able  to  use  confer¬ 
ence  documentation  to  plan  MPT-related 
initiatives  in  individual  and  Air  Force¬ 
wide  efforts. 

The  second  effort  is  the  C-17  Logistic 
Support  Analysis-Instructional  Systems 
Development  (LSA-ISD)  interface.  This 
program  was  initiated  to  provide  contract 
support  to  the  3306  Test  and  Evaluation 
Squadron  (TES)  for  initial  developmental 
efforts  to  automate  the  design  and  analy¬ 
sis  phases  of  the  ISD  process.  The  3306 
TES  (ATC)  will  be  the  user  of  the  proto¬ 
type  ISD  system.  AFHRL/MO  will  use  the 
knowledge  gained  in  training  R&D  on  other 
new  weapon  systems.  Objectives  of  the 
LSA-ISD  interface  are  to  provide  the  3306 
TES  with  accelerated  development  of  C-17 
training  materials  and  advanced  defini¬ 
tion  of  Air  Force  ISD  needs  for  new 
weapon  systems. 

The  effective  maintenance  of  complex 
systems  is  dependent  on  the  technical 
training  of  the  personnel  charged  to 
maintain  them.  Current  training  for  new 
acquisitions  is  deficient  because  of  the 
cumbersome  process  of  identifying  initial 
requirements.  This  process  involves 
manual  processing  of  voluminous  Logistic 
Support  Analysis  (LSA)  data,  engineering 
drawings,  and  data  supplied  by  the  system 
developer.  There  are  also  frequent 
changes  as  the  system  develops,  and 
numerous  problems  in  translating  these 
changing  data  into  training  materials. 
An  automated  system  is  needed  to  expedite 
the  entire  procedure;  provide  convenient 
and  rapid  means  to  locate,  match,  and 
update  the  changing  LSA  and  engineering 
data;  and  reformat  them  both  into 
products  convenient  for  ISD.  The  need 
is  especially  pressing  for  the  3306  TES 
at  Edwards  AFB,  the  unit  developing 
training  materials  for  use  at  field 
training  detachments  (FTD)  for  the 
Douglas  Aircraft  C-17.  Since  this  air¬ 
craft  is  in  the  production  phase,  the 
3306  TES  needs  an  off-the-shelf  computer¬ 
ized  system  to  expedite  their  ISD  effort. 
The  prototype  interface  was  demonstrated 


in  October  1987  at  Edwards  AFB  for 
individuals  representing  the  training 
technology  area  from  each  of  the  three 
military  Services.  The  prototype  inter¬ 
face  was  completed  and  presented  to  the 
3306th  TES  at  that  time,  along  with  a 
final  set  of  functional  specifications 
for  the  software  development. 

The  third  effort  concerns  weapon  -system 
specific  job  analysis.  This  R&D  effort 
is  designed  to  develop  task  identifica¬ 
tion  and  analysis  methods  that  can  be 
used  to  forecast  tasks  and  task  perform¬ 
ance  requirements  for  emerging  weapon 
systems.  To  accomplish  this  objective, 
the  attempt  is  being  made  (a)  to  link 
existing  task  identification/analysis 
data  bases,  (b)  to  use  data  resulting 
from  these  linkages  to  develop  weapon- 
system-specific  job  inventories,  (c)  to 
develop  improved  procedures  to  analyze 
new  inventory  data,  and  (d)  to  apply 
these  new  data  to  address  MPT-related 
is sues /problems . 

To  date,  the  following  three  tasks  have 
been  accomplished.  The  first  was  a 
scientific  evaluation  of  the  validity  and 
reliability  of  five  task-level  data 
bases:  Logistics  Composite  Model  (LCOM) , 
Maintenance  Data  Collection  System 
(MDCS),  Logistic  Support  Analysis  (LSA), 
Occupational  Survey  (OS)  data,  and 
Instructional  Systems  Development  (ISD). 
Included  in  this  evaluation  were  tasks 
measured  by  different  methods  and  their 
application,  method  of  data  collection, 
and  where  and  how  data  are  maintained. 
The  second  task  focused  on  user  needs 
assessment  in  the  areas  of  acquisition, 
personnel  management,  training,  and  com¬ 
bat.  The  third  task  dealt  with  linkages 
between  the  MDCS  and  OS  data  to  account 
for  LCOM  skill  level  tradeoffs. 

This  project  is  in  the  early  stage  of 
developing  data  bases,  technologies,  and 
procedures  needed  to  insert  MPT  tradeoffs 
into  weapon  systems  planning  and  design 
activities  to  improve  supportability , 
reduce  life-cycle  costs,  and  aid  weapon 
systems  fielding. 


Contact:  Dr.  R.  Bruce  Gould 

AFHRL/MODS 

Brooks  AFB  TX  78235-5601 
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COGNITIVE  SKILLS  ASSESSMENT  BRANCH 

This  Branch  designs  and  executes  labor¬ 
atory  experiments  to  identify  basic  cog¬ 
nitive  skills,  such  as  parameters  of 
learning  ability.  It  investigates  rela¬ 
tionships  of  these  skills  to  Air  Force 
training  and  job  performance  to  identify 
new  measures  for  improvement  of  Air  Force 
selection  and  classification  test  bat¬ 
teries  and  piocedures.  It  identifies 
such  candidate  measures  and  procedures 
to  the  Force  Acquisition  Branch  for  in¬ 
corporation  into  operational  systems.  The 
Branch  develops  and  maintains  an  automat¬ 
ed  testing  laboratory  necessary  for  these 
studies.  It  provides  experimental  data 
collection  services  for  both  computer- 
based  and  paper-and-penc il  testing  for 
other  division  programs. 


The  Learning  Abilities  Measurement 


LAMP  is  a  major  research  effort  in  cog¬ 
nitive  science  that  is  jointly  sponsored 
by  the  Air  Force  Office  of  Scientific 
Research  (AFOSR)  and  AFHRL.  It  is  sup¬ 
ported  by  facilities  at  Lackland  AFB 
which  house  30  microcomputer  testing 
stations  and  30  artificial  intelligence 
work-stations  for  delivery  of  intelligent 
computer-assisted  instruction.  Approxi¬ 
mately  300  airmen  in  basic  military 
training  are  available  as  subjects  each 
week,  and  over  50,000  have  participated 
in  testing  conducted  to  date. 

There  are  two  major  objectives  for  the 
LAMP  effort:  first,  to  identify  the 
basic  components  of  human  cognition;  and 
second,  to  determine  how  well  complex 
knowledge  and  skill  acquisition  can  be 
predicted  by  some  combination  of  these 
components.  The  first  objective  has  been 
pursued  since  1984.  It  is  hypothesized 
that  individual  differences  in  knowledge 
and  skill  acquisition  can  be  accounted 


Program  (LAMP) 
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SKILL/KNOWLEDGE 

ACQUISITION 
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Basic  trainees  participate  in  LAMP  program. 

for  by  two  major  categories  of  cognitive 
components:  Enablers,  which  include  all 
the  conceptual  knowledge  and  skills  the 
learner  has  upon  entering  instruction; 
and  Mediators,  which  include  processing 
capacity  and  processing  speed.  In  pur¬ 
suit  of  the  first  objective,  experimental 
tests  are  designed  to  assess  cognitive 
components  using  microcomputers  and  are 
subjected  to  detailed  internal  analysis 
to  determine  if  the  desired  ability  is 
indeed  being  measured.  Groups  of  tests 
assessing  cognitive  components  are  admin¬ 
istered  in  batteries  along  with  knowledge 
and  skill  acquisition  criterion  tasks  to 
obtain  an  initial  idea  of  the  predictive 
power  of  the  new  tests. 

R&D  addressing  the  second  objective  is 
just  getting  underway.  Intelligent 
tutoring  systems  are  being  developed  to 
teach  skills  in  electronics,  computer 
programming,  and  flight  engineering. 
Indicators  of  learning  progress  will  be 
obtained  from  these  tutors  and  will  serve 
as  criteria  against  which  experimental 
tests  developed  in  LAMP  can  be  validated. 
The  eventual  goal  is  to  cover  the  entire 
course  of  skill  acquisition,  from  learn¬ 
ing  the  basic  declarative  knowledge  need¬ 
ed  for  skill  execution,  through  procedur- 
alization  of  that  knowledge,  to  eventual 
automatization  of  the  skill. 


LAMP  investigates  the  nature  and  organi¬ 
zation  of  human  learning  abilities,  with 
the  ultimate  goal  of  contributing  to  a 
new  model-based  selection  and  classifica¬ 
tion  system  for  the  Air  Force.  LAMP 
research  conducted  thus  far  has  resulted 
in  a  tentative  model  of  the  mental  skills 
responsible  for  the  ability  to  learn. 
The  model  states  that  an  individual's 
skill  and  knowledge  levels  vary  along 
four  major  dimensions:  working  memory 
capacity,  information  processing  speed, 
factual  knowledge,  and  procedural  or 
strategic  knowledge.  The  model  also 
assumes  that  these  four  source  skills 
interact.  The  importance  of  having  a 
model  of  learning  ability  is  that  the 
model  can  suggest  means  for  constructing 
new  kinds  of  ability  tests,  and  can  also 
serve  as  the  basis  for  new  task  analysis 
systems.  The  model  will  eventually  help 
specify  what  kinds  of  cognitive  skills 
ought  to  be  measured  in  order  to  develop 
equations  for  predicting  the  likelihood 
that  a  person  will  succeed  in  training 
and  on  the  job. 

The  LAMP  effort  is  currently  staffed  by 
four  in-house  scientists.  Their  exper¬ 
tise  in  cognitive  science  is  augmented 
by  that  of  university  scientists  who 
participate  in  a  special  grant  program 
established  by  AFOSR.  AFHRL  provides 
testing  support  and  Air  Force  subjects 
to  university  scientists  who  wish  to 
contribute  to  the  LAMP  research  objec¬ 
tive. 


Proctor  monitors  LAMP  testing  program. 
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Although  this  program  is  devoted  to  basic 
research,  usable  outcomes  are  anticipat¬ 
ed.  For  example,  a  major  goal  is  to 
develop  new  ability  measures  for  inclu¬ 
sion  in  future  personnel  selection  and 
classification  programs.  As  in  any  basic 
research  program,  however,  it  will  be  a 
number  of  years  before  the  contribution 
of  LAMP  is  fully  known.  But  the  results 
of  early  studies  and  the  vision  of  ulti¬ 
mate  success  have  already  generated 
excitement  in  the  scientific  community, 
as  well  as  in  AFHRL. 

Contact:  Dr.  William  C.  Tirre 

AFHRL/MOEL 

Brooks  AFB  TX  78235-5601 
Commercial;  (512)536-3570 
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PORTA-BAT 


Aircrew  Selection  Programs 

The  Air  Training  Command  (ATC)  field  test 
of  the  Pilot  Candidate  Selection  Method 
(PCSM)  is  progressing  on  schedule.  The 
PCSM  combines  scores  from  the  Air  Force 
Officer  Qualifying  Test  (AFOQT),  grades 
from  the  last  four  sorties  of  the  Flight 
Screening  Program  (FSP),  biographical 
information,  and  scores  from  a  psycho¬ 
motor  (hand-eye  coordination)  test  into 
a  final  score  that  is  highly  predictive 
of  success  in  pilot  training.  The  psy¬ 
chomotor  test  is  given  by  the  PORTA-BAT 
test  system. 

The  PORTA-BAT  also  gives  a  battery  of 
information  processing  and  personality 
tests  referred  to  as  the  Basic  Attributes 
Tests  (BAT).  The  BAT  and  PORTA-BAT  are 
being  used  by  allied  air  forces  in  two 
major  international  R&D  programs.  The 
Royal  Australian  Air  Force  began  a  co¬ 
operative  testing  program  with  AFHRL  in 
June  1986.  Two  PORTA-BAT  systems  were 
sent  to  Australia  and  are  being  used  to 
test  pilot  applicants,  helicopter  pilots 
from  the  Australian  Army  and  Navy,  and 
combat  crewmembers  from  operational 
squadrons.  The  goals  of  this  program 
are:  to  independently  validate  the  BAT 
as  a  screening/classification  instrument 
for  pilot  selection  and  classification, 
to  examine  the  utility  of  the  BAT  for 
selecting  helicopter  pilots  and  other 
aircrew  positions,  and  to  suggest 
possible  tests  or  improvements  from 
Australian  R&D  programs. 

A  second  international  R&D  program  is 
being  conducted  as  part  of  AFHRL' s  sup¬ 
port  of  the  EURO-NATO  Aircrew  Selection 
Working  Group.  In  this  program,  the 
PORTA-BAT  is  being  used  in  Germany,  Great 
Britain,  Denmark,  the  Netherlands, 
Norway,  Belgium,  Italy,  and  Portugal,  as 
part  of  an  effort  to  improve  the  selec¬ 
tion  of  fast-jet  (fighter)  pilots  for 
entry  into  the  EURO-NATO  Joint  Jet  Pilot 
Training  (ENJJPT)  Program.  This  project 
is  designed  to  select  pilots  who  will 
succeed  in  becoming  "fighter  pilots"  as 
opposed  to  the  universally  assignable 
pilot  produced  by  the  USAF  Undergraduate 
Pilot  Training  (UPT)  program.  The  aim 
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PORTA-BATs  are  dispersed  worldwide. 


of  the  Working  Group  is  to  increase  the 
success  rate  of  ENJJPT  candidates  and 
establish  a  standard  NATO  pilot  selection 
system.  Each  participating  nation  has 
had  the  use  of  PORTA-BAT  to  test  appli¬ 
cants  during  some  portion  of  1986  and 
1987.  Data  are  being  shared  between  the 
individual  nations  and  AFHRL  who  is 
analyzing  the  aggregate  performance  of 
all  entrants  in  a  combined  sample. 

Installation  of  a  fighter  pilot  perform¬ 
ance  measurement  system  in  the  Air  Combat 
Maneuvering  Instrumentation  Range  (ACMI) 
at  Luke  AFB  is  scheduled  for  completion 
in  late  1988.  Data  gathered  from  "real- 
world"  airborne  performance  on  the  range 
will  help  establish  criteria  for  selec¬ 
tion  into  the  fighter  training  track 
within  the  Specialized  Undergraduate 
Pilot  Training  (SUPT)  program. 


Analysis  continues  in  the  performance  of 
USAF  ENJJPT  graduates  against  USAF  UPT 
graduates  in  Lead-In  Fighter  Training 
(lift).  The  project  is  designed  to 
investigate  the  effect  of  different 
training  syllabi  used  by  the  UPT  and 
ENJJPT  programs  on  common  performance  in 
follow-on  fighter  training  programs. 

Two  related  projects  using  PORTA-BATs  to 
improve  aircrew  selection  are  planned. 
One  PORTA-BAT  will  be  sent  to  Mather  AFB 
for  Undergraduate  Navigator  Training 
studies  and  another  will  go  to  Ft.  Rucker 
for  a  joint  R&D  effort  with  the  Army 
Research  Institute  on  undergraduate 
helicopter  training.  Currently  under 
consideration  are  proposals  for  joint 
testing  programs  with  Israel  and  India. 

Contact:  Lt  Col  Bill  Ercoline 

AFURL/MOEA 

Brooks  AFB  TX  78235-5601 
Commercial:  (512)536-3570 

AUIUVON:  240-3570 


FORCE  MANAGEMENT  SYSTEMS  BRANCH 

The  Force  Management  Systems  Branch 
develops  and  monitors  dynamic  models  used 
to  describe  the  Air  Force  manpower  and 
personnel  system.  It  develops  and 
applies  new  methodology  or  technology 
toward  effective  personnel  subsystem 
design.  It  applies  existing  technology 
in  the  development  of  models  for  opera¬ 
tional  users  to  aid  iu  their  management 
decisions  and  in  forecasting  future  needs 
to  meet  mission  objectives,  and  conducts 
research  into  a  wide  range  of  Air  Force 
personnel  and  manpower  problems  which 
occur  during  the  military  career  life 
cycle  (recruitment  to  retirement).  It 
also  conducts  R&D  to  assess  jobs  to 
improve  training  and  adjustability. 


Basic  Job  Skills  Research  Program 

Modern  Air  Force  work  centers  reflect  the 
advances  that  have  established  the  Air 
Force  as  a  "technological  pacesetter"  in 
today's  world.  That  role  carries  with 
it  the  need  to  define  the  intellectual 
demands  that  complex  systems  levy  on 
workers,  so  that  training  can  be  designed 
to  keep  pace  with  rapidly  developing 
hardware  technologies.  In  response  to 
this  need,  a  large-scale  R&D  effort — the 
Basic  Job  Skills  (BJS)  Research  Program — 
has  been  initiated.  The  overall  goal  is 
twofold:  (a)  to  examine  Air  Force  occu¬ 
pations  in  order  to  define  high-tech 
competence  in  terms  of  the  skills  that 
are  shared  across  domains,  and  (b)  to 
develop  adaptive  training  based  on  the 
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skill  coiranonalities .  Basic  job  skills 
are  defined  as  the  core  knowledge  and 
thinking  processes  that  underlie  expert 
performance  in  the  Air  Force's  most 
technically  demanding  tasks.  They  can 
be  considered  the  components  of  scien¬ 
tific  literacy  needed  for  performance  in 
today's  high-tech  work  environments. 

Precise  definitions  of  shared  skills  can 
produce  answers  to  questions  about  the 
optimal  knowledge  humans  should  have  in 
work  centers  saturated  by  "smart  ma¬ 
chines."  Training  will  be  able  to  focus 
on  the  thinking  required  for  modern  Air 
Force  work  centers,  with  the  goal  of 
fostering  "performance  with  understand¬ 
ing."  Payoffs  will  also  be  derived  from 
centralizing  the  instruction  for  thou¬ 
sands  of  apprentices  in  a  streamlined 
instructional  system  that  takes  advantage 
of  Air  Force  Specialties  (AFS)  commonal¬ 
ities  . 

A  three-stage  R&D  approach  has  been 
implemented  to  produce  task  analyses, 
diagnostic  tests,  and  training  outcomes. 
First,  cognitive  task  analysis  methods 
to  capture  the  mental  processes  of  tech¬ 
nical  expertise  are  developed  and  tested. 
In  the  second  stage,  problem-oriented 
tests  are  developed  to  diagnose  trainees' 
deficits  in  the  skill  areas.  In  the 
third  stage,  results  from  cognitive 
analyses  provide  the  basis  for  a  series 
of  problem-oriented  training  systems 
designed  to  cover  more  and  more  skills 
and  occupations.  The  initial  instruc¬ 
tional  systems  will  present  trainees 
simulated  troubleshooting  environments 
using  intelligent  tutor  computer  systems. 
During  FY87,  three  specific  efforts  tied 
together  the  three-stage  R&D  approach  to 
produce  effective  training  systems. 

A  successful  proof-of-concept  training 
R&D  effort  was  accomplished  in  November 
1986  with  avionics  maintenance  techni¬ 
cians.  The  primary  goal  of  the  project 
was  to  test  the  BJS  project's  fundamental 
concept;  namely,  that  the  mental  pro¬ 
cesses  of  technical  expertise  that  are 
captured  through  cognitive  task  analyses 
can  spawn  an  effective  instructional  pro¬ 
gram.  In  the  effort,  statistically 


significant  improvements  in  the  trouble¬ 
shooting  efficiency  of  novice  airmen  were 
obtained  after  five  hours  or  less  of 
tutoring  on  authentic  troubleshooting 
scenarios . 

The  initial  operational  test  and  evalua¬ 
tion  of  the  first  major  BJS  training 
system  was  initiated  in  August  1987. 
The  Avionics  Troubleshooting  Tutor 
provides  approximately  50  hours  of 
instruction  for  F-15  integrated  avionics 
technicians  in  an  intelligent  tutoring 
system  practice  environment.  The 
effectiveness  of  the  tutor  is  being 
evaluated  in  a  controlled  experiment  at 
three  F-15  TAG  bases.  The  evaluation 
project  goals  are  to  determine  how  much 
experience  (in  terms  of  months  on  the 
job)  the  tutor  provides  and  how  the 
accelerated  rate  of  acquiring  technical 
experience  impacts  shop-level  productiv¬ 
ity. 

Prototype  development  of  computer-based 
BJS  instruction  was  completed  for  an 
important  technical  skill  in  electronic 
domains  —  facility  with  digital  circuitry 
logic  gates.  The  instruction  utilizes 
intensive  cognitive  diagnostic  methods 
derived  from  cognitive  task  analyses 
results.  An  individual  trainee's  partic¬ 
ular  knowledge  deficits  and  procedural 
weaknesses  are  diagnosed,  and  then  a 
tailored  training  regimen  is  delivered 
via  computer. 

A  new  approach  to  personnel  assessment 
and  training  will  be  investigated  in 
FY88.  Based  on  cognitive  task  analysis 
of  Air  Force  Specialty  Codes  (AFSCs), 
improved  diagnostic  tests  to  identify 
basic  skill  deficiencies  will  be  develop¬ 
ed.  This  work  will  be  followed  up  by  a 
6.3  basic  skills  project  which  will  be 
training-  as  well  as  testing-oriented.  A 
prototype  basic  skills  training  program 
will  be  developed  and  validated  against 
measures  of  job  effectiveness.  Diagnos¬ 
tic  tests  and  training  programs  will  be 
developed  for  additional  AFSCs  during 
FY88  to  FY92.  A  complete  basic  skills 
testing  and  training  program  will  be 
transitioned  to  the  Air  Force  for 
operational  use  in  FY92. 
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Contact:  Dr.  Sherrie  P.  Gott 

AFHRL/MOMJ 

Brooks  AFB  TX  78235-5601 
Commercial:  (512)  536-3942 

AUTOVON:  240-3648 


Productivity  Measurement /Enhancement 

Air  Force  organizations  are  under  tre¬ 
mendous  pressures  to  reduce  the  cost  of 
operation  while  at  the  same  time  main¬ 
taining  or  even  increasing  their  produc¬ 
tivity.  The  President's  recent  Executive 
Order  to  increase  productivity  by  20 
percent  by  1992,  and  the  Gramm/Rudman/ 
Hollings  Budget  Reduction  Act,  have 
placed  an  additional  strain  on  military 
organizations.  Existing  methods  of  meas¬ 
uring  productivity  are  too  simplistic  and 
have  little  motivational  value  for  work¬ 
ers.  What  is  needed  is  a  tool  which  not 
only  measures  unit  productivity  but  also 
provides  avenues  for  increasing  unit  per¬ 
formance  and  improving  worker  motivation. 


AFHRL  R&D  on  feedback,  goal  setting,  and 
incentive  systems  and  productivity  meas¬ 
urement  has  culminated  in  a  series  of 
technologies,  collectively  called  the 
Methodology  for  Generating  Efficiency  and 
Effectiveness  Measures  (MGEEM) ,  which 
permit  the  development,  in  any  organiza¬ 
tion,  of  a  complete  productivity  measure¬ 
ment  and  enhancement  system.  Developing 
an  MGEEM  system  requires  a  measurement 
coordinator  who  guides  members  of  the 
target  organization  through  a  multistep 
process  to  clarify  what  the  organization 
is  expected  to  produce,  called  Key 
Results  Areas  (KRAs) ,  and  to  identify 
means  of  evaluating  how  well  the  organi¬ 
zation  is  accomplishing  its  KRAs,  called 
indicators.  Reports  for  feedback  to 
management  and  workers  are  accomplished 
with  the  target  organization's  existing 
data  automation  system. 

With  comparatively  low  start-up  and 
operational  costs,  the  MGEEM  can  incor¬ 
porate  part  or  all  of  an  organization's 
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existing  accounting  and  engineering  sys¬ 
tems,  but  goes  beyond  these  measures,  to 
directly  assess  all  important  aspects  of 
the  mission.  The  MGEEM  is  highly  motiva¬ 
tional  because  its  design  considers  work¬ 
er  input,  yet  it  preserves  the  preroga¬ 
tives  of  traditional  military  management. 
Extensive  field  tests  of  the  MGEEM  show 
that  it  dramatically  increases  organiza¬ 
tional  productivity  from  67  to  93  per¬ 
cent,  and  is  motivational  because  of  its 
use  of  feedback,  goal  setting,  and  incen¬ 
tives.  Commanders  report  that  the  MGEEM 
focuses  on  the  truly  important  aspects 
of  the  organization's  mission.  In  addi¬ 
tion,  MGEEM  increases  management's  con¬ 
trol  by  identifying  problems  before  they 
become  serious,  diagnosing  causes  for 
problems,  knowing  when  problems  are 
fixed,  identifying  priorities  for  in¬ 
creasing  productivity  and  better  allocat¬ 
ing  resources. 

There  has  been  widespread  interest  and 
activity  in  MGEEM  during  FY87.  In  April 
1987,  a  Productivity  Workshop  was  held 
at  Brooks  AFB  with  over  30  representa¬ 
tives  of  major  commands  attending.  This 
workshop  provided  a  tutorial  on  how  to 
implement  the  MGEEM  in  their  organiza¬ 


tions.  Several  implementations  are  in 
progress  or  planned  in  the  Air  Force, 
including  the  Plans  and  Programs  organi¬ 
zation  and  Procurement  Directorate  of  Air 
Force  Logistics  Command,  Air  Force  Man¬ 
agement  Engineering  Agency,  Electronic 
Security  Command,  Air  Force  Office  of 
Security  Police,  Pacific  Air  Forces,  and. 
Tactical  Air  Command.  In  the  Navy,  the 
Aircraft  Intermediate  Maintenance  Depart¬ 
ment  at  North  Island  Air  Station  of  Navy 
Air  Forces  Pacific  implemented  MGEEM  in 
June  1987,  while  the  Naval  Weapons  Eval¬ 
uation  Facility  is  planning  to  implement 
it.  AFHRL  has  also  submitted  a  proposal 
to  the  Office  of  Assistant  Secretary  of 
Defense  for  a  tri-Service  test  and  eval¬ 
uation  of  MGEEM  in  aircraft  maintenance 
organizations.  In  addition,  both  the 
Office  of  Management  and  Budget,  and  the 
Department  of  Defense,  are  considering 
the  usefulness  of  MGEEM  in  satisfying  the 
President's  Productivity  Program  goals. 

Contact:  Dr.  Charles  N.  Weaver 

AFHRL/MOMD 

Brooks  AFB  TX  78235-5601 

Commercial:  (512)  536-3551 

AUTOVON:  240-3551 
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VALUE  (FAIR  FORCE  EXPERIENCE 


Value  of  Air  Force  Experience 

In  reacting  to  budgetary  constraints  and 
cost-saving  measures  and  initiatives,  the 
Air  Force  is  constantly  faced  with  making 
decisions  about  the  nature  of  the  enlist¬ 
ed  and  officer  force  structure  mixes. 
Unfortunately,  many  of  these  decisions 
are  made  with  very  little  information 
about  the  impact  that  cost-cutting  might 
have  on  mission  accomplishment.  Also, 
not  considered  is  the  impact  that  cost 
savings  taken  today  might  have  on  the 
future  ability  of  the  Air  Force  to 
recruit  and  retain  the  kinds  of  people 
necessary  to  operate  and  maintain  the 
complex  weapon  systems  that  will  be  in 
the  inventory.  The  key  to  answering  such 
questions  is  a  defensible  and  scientifi¬ 
cally  founded  methodology  to  quantify  the 
value  of  experience  gained  in  the  Air 
Force  in  critical  occupations  and  duty 
assignments.  Such  a  methodology  would 
enable  Air  Force  manpower,  personnel,  and 
training  planners  to  respond  to  Congres¬ 


sional  and  DOD  inquiries  about  the  impact 
of  losing  trained  personnel  and  empower 
them  to  make  better-informed  force  struc¬ 
ture  tradeoff  decisions. 

The  R&D  effort  to  develop  such  a  method¬ 
ology  is  being  accomplished  in  three 
phases.  The  objective  of  Phase  I  is  to 
define  the  unique  characteristics  of  the 
Air  Force  job  environment,  training,  and 
occupational  experience  that  may  suggest 
one  or  more  of  the  currently  accepted 
human  value  models  (e.g.,  human  resource 
accounting  or  human  capital  modeling). 
The  R&D  may  also  explore  policy  and 
decision  modeling  of  key  value  variables. 
Necessary  assumptions,  and  reasons  why 
one  or  more  of  the  models  is  preferable 
to  another  for  use  in  the  Air  Force  and 
military  setting,  are  being  examined. 

In  Phase  II,  one  or  more  of  the  current 
human  value  models,  modifications  of  the 
models,  or  new  approaches  will  be  select¬ 
ed  for  testing  in  the  Air  Force  setting. 
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Models  will  be  developed  for  several  key 
Air  Force  occupations,  occupational 
groupings,  and  experience  year  groups. 
In  Phase  III,  the  sensitivity  of  the 
models  to  changes  in  assumptions,  costs, 
time  horizons,  and  other  key  decision 
variables  will  be  evaluated.  Concrete 
suggestions  will  be  made  as  to  the  feas¬ 
ibility  of  extending  the  models  to  the 
larger  Air  Force  occupational  arena. 

The  R&D  being  conducted  will  result  in  a 
policy  analysis  tool  which  will  improve 
Air  Force  understanding  of  the  cost  and 
value  of  replacing  personnel  who  possess 
critical  Air  Force  skills.  Such  a  model 
will  improve  the  Air  Force's  budgeting 
and  manpower,  personnel,  and  training 
decision-making  processes.  Better  inform¬ 
ed  force  structure  and  retention  policies 
should  also  result  from  this  knowledge. 

Following  an  extensive 
review  of  the  pertinent 
literature  in  human  re¬ 
source  accounting  (HRA) 
and  human  capital  model¬ 
ing,  a  request  for  pro¬ 
posal  was  issued  under 
the  Program  Research  De¬ 
velopment  Announcement 
(PRDA)  procurement  pro¬ 
gram,  and  two  firms  were 
awarded  contracts  in 
April  1987.  One  of  the 
firms,  RRC  Inc.  of  Bryan 
TX,  is  employing  Dr.  Eric 
Flamholtz's  HRA  model  and 
has  him,  the  nation's 
leading  expert  on  the 
application  of  HRA,  under 
consulting  subcontract. 

RRC  is  focusing  on  key 
cost  variables  and  how 
they  could  be  used  to  value  experience. 
The  other  firm.  Advanced  Technology  of 
Reston  VA,  is  evaluating  a  wide  range  of 
possible  ways  to  measure  the  current 
worth  of  an  Air  Force  individual  in  a  job 
and  will  ultimately  produce  a  software 
package  which  will  incorporate  both 
firms'  value  models.  Both  firms'  models 
will  be  tested  on  critical  enlisted  and 
officer  occupations  for  which  personnel 
may  be  difficult  to  replace  or  retain 
and/or  costly  to  train. 


Contact:  Mr.  Larry  Looper 
AFHRL/MOMD 

Brooks  AFB  TX  78235-5601 
Commercial:  (512)  536-3942 

AUTOVON:  240-3942 


Expansion  of  Person-Job  Match  (PJM) 
Technology 

With  reduced  budgets  and  an  increasing 
emphasis  on  cost  reduction,  the  Air  Force 
must  utilize  its  limited  resources  to 
train  personnel  and  maintain  a  force  with 
sufficient  talent  and  ability  to  accom¬ 
plish  its  mission.  Key  to  making  optimal 
use  of  important  personnel  resources  is 
making  the  best  possible  decisions  about 
selecting,  classifying,  and  assigning 
personnel.  Existing  systems  for  making 
these  decisions  can  be  improved  resulting 


Person-job  matching  begins  with  recruitment. 

in  a  more  effective  selection  and  classifi¬ 
cation  process.  This  improvement  is  being 
accomplished  through  the  expansion  of 
Person-Job  Match  (PJM)  technology. 

There  are  three  enlisted  selection  and  clas¬ 
sification  systems  used  by  managers  at  Air 
Training  Command  (ATC),  Air  Force  Military 
Personnel  Center  (AFMPC),  and  Recruiting 
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PJM 

CLASSIFICATION  SYSTEMS 


Service.  The  Procurement  Management  In¬ 
formation  System  (PROMIS)  selects  and 
classifies  nonprior-service  enlisted  per¬ 
sonnel  into  specific  Air  Force  Special¬ 
ties  (AFSs)  or  into  an  Air  Force  aptitude 
area  (Mechanical  (M) ,  Administrative  (A), 
General  (G),  or  Electronics  (E)).  Per¬ 
sonnel  classified  into  an  area  are  called 
aptitude  index  (Al)  enlistments.  The 
Processing  and  Glassification  of  En¬ 
listees  (PACE)  system  classifies  the  AI 
personnel  into  specific  AFSs  during  basic 
training.  In  the  retraining  area,  over 
10,000  airmen  are  selected  each  year  for 
retraining  into  new  specialties.  The  R&D 
efforts  in  support  of  PROMIS,  PACE,  and 
retraining  will  improve  the  selection  and 
classification  of  airmen. 


The  PROMIS  classification  algorithm 
assigns  personnel  at  time  of  enlistment 
based  on  the  worth  or  payoff  of  that 
person  in  an  AFS  combined  with  the  pre¬ 
diction  of  future  accessions  for  the  AFS. 
During  FY87,  the  R&D  efforts  to  enhance 
PROMIS  included  new  methods  to  predict 
future  accessions  and  consideration  of 
alternate  sequential  classification  algo¬ 
rithms.  Researcli  is  continuing  on  several 
issues  such  as  adding  new  information  for 
use  in  evaluating  the  worth  of  a  person 
on  a  job,  including  the  Vocational 
Interest-Career  Examination,  and  imple¬ 
menting  improved  regression  equations  to 
predict  technical  school  success. 
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Research  in  progress  will  upgrade  PACE 
to  take  advantage  of  past  PJM  R&D  and  use 
state-of-the-art  linear  programming  tech¬ 
niques.  During  FY87,  a  new  PACE  prototype 
algorithm  was  developed  through  extensive 
discussions  with  managers  at  ATC  and  the 
3507  Airman  Classification  Squadron  at 
Lackland  AFB.  Initial  testing  using 
actual  training  week  group  data  was 
started.  In  addition,  R&D  is  continuing 
to  test  and  evaluate  the  prototype  by 
running  both  the  existing  and  new  PACE 
classification  systems  in  parallel,  and 
to  develop  an  upgraded  version  of  the  new 
PACE  program. 

The  primary  objective  of  the  retraining 
classification  R&D  is  to  develop  a  meth¬ 
odology  that  will  optimally  classify 
enlisted  personnel  selected  for  retrain¬ 
ing.  The  current  system  is  a  nonoptimal 
paper-and-pencil  matching  process.  The 
new  retraining  system  will  utilize  PJM 
selection  and  classification  methodology 
already  developed  in  the  PROMTS  and  PACE 
systems.  During  FY87,  a  classification 


algorithm  for  nonvolunteer  personnel  was 
developed  in  close  cooperation  with  AFMPC 
retraining  managers  and  is  now  undergoing 
operational  testing.  Research  to  develop 
a  system  for  retraining  volunteers  is  now 
getting  started. 

The  R&D  effort  will  result  in  three  sys¬ 
tems  which  will  classify  personnel  in  a 
similar  and  optimal  manner.  A  project 
to  assess  and  quantify  the  benefits  to 
be  derived  from  this  R&D  was  recently 
begun.  Several  areas  being  examined 
include  increased  retention,  less  attri¬ 
tion,  less  casual  time,  improved  matching 
of  abilities  with  the  difficulty  of  the 
AFS,  and  increased  job  satisfaction  and 
motivation  by  better  consideration  of 
personal  interests. 

Contact:  Dr.  Manuel  Pina,  Jr. 

Capt  Mark  Emerson 
AFHRL/MOMD 

Brooks  AFB  TX  78235-5601 
Commercial:  (512)  536-3942 

AUTOVON:  240-3942 
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OPERATIONS  TRAINING  DIVISION 


The  Operations  Training  Division  (OT)  of 
AFHRL  has  a  unique  role  as  the  only  Air 
Force  agency  devoted  to  the  exploitation 
of  science  and  technology  to  improve  air¬ 
crew  training.  The  Division's  R&D  pro¬ 
grams  dynamically  contribute  to  the  ef¬ 
fectiveness  and  efficiency  of  flying 
training  throughout  the  Air  Force. 

Formed  in  1969  as  that  integral  part  of 
AFHRL  responsible  for  flying  training, 
OT  performs  its  mission  through  two 
primary  functions:  (a)  behavioral  R&D  to 
solve  flying  training  problems  through 


improved  technology,  and  (b)  engineering 
R&D  to  develop  devices  that  become 
vehicles  for  R&D  and  training.  The 
people  who  staff  these  two  areas  form  a 
diverse  multidisciplinary  team  of  spe¬ 
cialists  ranging  from  psychologists,  R&D 
instructor  pilots,  and  human  factors 
specialists  to  aerospace  engineers, 
mathematicians,  and  computer  technolo¬ 
gists.  With  this  uncommon  mix  of  exper¬ 
tise,  the  Division  converts  training 
needs  into  the  knowledge  and  products 
needed  to  improve  the  combat  effective¬ 
ness  of  operational  commands. 


TECHNOLOGY  DEVELOPMENT  BRANCH 

The  Technology  Development  Branch  plans, 
programs,  develops,  and  evaluates  proto¬ 
type  aircrew  training  devices  to  serve 
as  research  vehicles  and  technology  dem¬ 
onstrators.  Products  of  this  Branch  are 
primarily  aircraft  simulator  components 
and  part-task  trainers,  including  host 
computational  systems,  image  (visual, 
radar,  and  infrared)  operators,  image 
display  devices,  and  technical  evalua¬ 
tions  thereof. 


Aircrew  Combat  Mission  Enhancement 

Aircrew  Combat  Mission  Enhancement  (ACME) 
is  a  Forecast  II  project  whose  goal  is 
the  enhancement  of  combat  mission  readi¬ 
ness  through  advances  in  flight  simula¬ 
tion  technology.  There  are  two  principal 
products  that  will  be  developed  and  de¬ 
livered  under  ACME.  These  are:  (a)  a 
situational  awareness  training  capability 
that  will  permit  multiship  force-on- force 
combat  simulation,  and  (b)  a  mission 
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The  near-term  objective  of  the  Aircrew  Combat  Mission  Enhancement  (ACME)  project 
is  to  provide  advanced,  cost-effective  simulator  technology  for  combat  situational 
awareness  and  team  training,  mission  rehearsal,  and  mission  planning  systems  for 
tactical  aircrews. 


[♦lij 


rehearsal  training  capability  that  will 
permit  terrain/target  familiarization  and 
practice  of  attack  coordination  and  tim¬ 
ing. 

The  need  for  ACME  is  based  on  prevailing 
operational  problems,  including  the 
inherent  limitations  in  the  use  of  cur¬ 
rent  tactical  ranges  and  the  fact  that 
frequency  of  practice  is  severely  limit¬ 
ed.  Furthermore,  there  are  presently  no 
capabilities  within  the  Tactical  Air 
Forces  (TAF)  which  permit  mission  re¬ 
hearsal.  In  order  to  address  these  oper¬ 
ational  limitations,  there  are  pushes  in 
current  technology  which  are  necessary, 
including  affordable  simulation  compo¬ 
nents,  long-haul  networking  for  inter¬ 
active  force-on-force  exercises,  and 
rapid  turnaround  data  bases  for  mission 


rehearsal.  There  is  also  a  need  to 
expand  our  knowledge  in  the  areas  of 
understanding  the  skills  required  for 
situational  awareness  and  mission  re¬ 
hearsal,  fidelity  requirements  for  train¬ 
er  components,  effectiveness  of  ACME  pro¬ 
ducts,  and  understanding  of  how  these 
products  would  be  integrated  within  the 
total  training  system. 

ACME  is  a  Forecast  II  technology  for 
which  AFHRL  is  the  lead  organization. 
Forecast  II  resulted  in  an  AFSC-wide 
program  to  develop  39  technologies  and 
31  advanced  systems  concepts  that,  hope¬ 
fully,  will  revolutionize  the  way  the  Air 
Force  carries  out  its  mission  in  the  21st 
century,  guaranteeing  continued  techno¬ 
logical  supremacy  over  any  potential 
adversary.  The  objective  of  ACME  is  to 


provide  cost-effective  simulator  technol¬ 
ogy  for  combat  mission  training,  mission 
rehearsal,  and  mission  planning  for  tac¬ 
tical  aircrews.  This  technology  would 
be  provided  by:  expediting  the'  develop¬ 
ment  of  high-resolution,  multispectral, 
geographic  gaming  areas;  expediting  the 
development  of  very-high-speed  integrated 
circuit  (VHSIC)  computer-based  systems 
that  allow  increased  simulation  capabil¬ 
ity  while  significantly  reducing  size  and 
cost;  developing  the  helmet-mounted  dis¬ 
play  and  multiparticipant  networking 
technologies  required  to  support  simula¬ 
tion  of  tactical  combat  tasks;  and  inte¬ 
grating  diverse  technologies  to  define 
combat  mission  training,  mission  rehears¬ 
al,  and  mission  planning  systems  for 
high-threat  environments.  Other  orga¬ 
nizations  working  with  AFHRL  in  the  con¬ 
duct  of  ACME  are:  the  Air  Force  Wright 
Aeronautical  Laboratories  (AFWAL),  the 
Rome  Air  Development  Center 
(RADC),  the  Armstrong  Aerospace 
Medical  Research  Laboratory 
(AAMRL),  and  the  Aeronautical 
Systems  Division  (ASD) . 

Important  milestones  are:  demon¬ 
strate  integrated  visual,  infra¬ 
red,  and  synthetic  radar  capabil¬ 
ity  in  the  Advanced  Visual  Tech¬ 
nology  System  (AFHRL/6 . 3/FY88 ) ; 
demonstrate  ACME  brassboard  of 
airborne  graphics  generation  sys¬ 
tem  (AFWAL/6 . 2/FY88 ) ;  demonstrate 
automatic  vertical  feature  ex¬ 
traction  (RADC/6 . 3/FY90) ;  tacti¬ 
cal  networking  concept  defini¬ 
tion  (AFHRL/6 . 2/FY90) ;  demon¬ 
strate  brassboard  miniature  real¬ 
time  computational  system  (AFWAL/ 

6.3/  FY91);  demonstrate  multi¬ 

source  imagery  merger  and  display  (RADC/ 
6.3/FY93);  and  delivery  of  a  computer 
image  generation  unifying  device  (AFHRL/ 
6.3/FY96) . 

The  near-term  Situational  Awareness 
Training  (SAT)  system  development  program 
will  produce  an  interactive  force-on- 
force  simulation  of  a  wartime  environ¬ 
ment.  To  accomplish  this,  an  F-16  multi¬ 
ship  network  will  be  developed  at 
Williams  AFB.  The  network  will  consist 


of  high-fidelity  simulators,  low-fidelity 
pilot  stations,  generic  operator  control 
stations,  a  mission  control  station,  and 
a  modular  threat  simulation  system.  The 
network  will  enable  up  to  14  live  play¬ 
ers  to  participate  in  tactical  scenarios. 
This  complex  will  have  the  capability  for 
long-haul  networking  to  other  simulation 
facilities.  Candidate  facilities  include 
the  Simulator  for  Air-to-Air  Combat  lo¬ 
cated  at  Luke  AFB,  the  Visual  Training 
Research  Simulator  facility  of  the  Naval 
Training  Systems  Center  located  at 
Orlando,  the  SIMNET  complex  located  at 
Ft.  Knox,  a  new  R&D  simulation  complex 
being  built  at  Ft.  Rucker,  and  the  pro¬ 
posed  Fighter  Battle  Management  Facility 
at  Wr ight-Patterson  AFB.  This  network 
will  be  expanded  for  inclusion  of  select¬ 
ed  command  and  control  capabilities.  The 
situational  awareness  training  capability 
will  be  delivered  by  FY92. 


The  Mission  Rehearsal  (MR)  system  devel¬ 
opment  program  will  produce  a  system 
capable  of  prestrike  mission  planning  and 
rehearsal.  It  will  enable  crews  to 
practice  waypoint/target  area  familiar¬ 
ization  and  attack  coordination  and  tim¬ 
ing.  Technology  requirements  include  the 
development  of  a  multispectral  image 
generator  and  a  quick  turnaround  data¬ 
base  facility.  These  will  be  integrated 
with  the  situational  awareness  training 
facility  and  be  available  by  FY96. 


A  vigorous  progidiii  of  behavioral 
R&D  will  be  undertaken  in  sup¬ 
port  of  these  two  development 
programs.  For  each,  there  is  a 
need  for  identification  of 
training  requirements  and  an 
assessment  of  the  underlying 
aircrew  skills.  For  the  situa¬ 
tional  awareness  program,  fidel¬ 
ity  requirements  for  the  various 
trainer  components  will  be 
identified  as  well  as  feedback 
requirements  for  effective 
training  and  practice.  For 
mission  rehearsal,  the  primary 
behavioral  issue  is  the  one  of 
data  base  requirements.  Upon 
completion  of  these  development 
efforts,  their  effectiveness 
will  be  evaluated,  and  integra¬ 
tion  into  the  total  training 
system  will  be  addressed. 

Although  ACME  is  a  new  program, 
significant  progress  has  been 
made.  Component  development 
efforts  are  underway  in  the 
areas  of  visual  image  generation 
and  display  systems.  A  multi- 
spectral  image  generation  capa¬ 
bility  within  the  Advanced 
Visual  Technology  System  is 
nearing  completion.  A  second- 
generation  fiber-optic  helmet- 
mounted  display  has  been  deliv¬ 
ered  and  is  currently  being 
evaluated.  Development  efforts 
are  also  underway  for  two  dome 
display  systems  employing  vari¬ 
able  acuity  optics.  Other  com¬ 
ponents  of  the  situational 
awareness  training  system  are 
currently  in  the  design  stage 
including  the  required  network¬ 
ing  communication  standard,  the 
mission  control  stations,  the 
modular  threat  simulation  sys¬ 
tem,  and  a  series  of  low-cost 
combat  stations  that  will  permit 
increases  in  the  number  of  play¬ 
ers  within  the  simulation  sce¬ 
narios.  It  is  expected  that 
development  of  these  systems 
will  begin  during  FY88. 
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Contact:  Dr.  Wayne  L.  Waag 
AFHRL/OTE 

Williams  AFB  AZ  85240-6457 
Commercial:  (602)  988-6561 
AUTOVON:  474-6561 


This  full-color,  collimated,  stereoscopic 
display  is  exceptionally  bright,  thus  al¬ 
lowing  the  pilot  to  make  full  use  of 
high-detail  scenes. 


visual  Training  Effectiveness  R&D 


R&D  in  this  area  is  concerned  with  deter¬ 
mining  the  training  benefits  associated 
with  various  aspects  of  the  visual  dis¬ 
play  and  associated  imagery  for  out-of- 
the-cockpit  flight  simulation.  The  three 
components  that  drive  the  cost  of  today's 
systems  are  the  image  generator  (IG), 
the  data  base,  and  the  display  itself. 
The  primary  objective  is  to  relate  the 
level  of  fidelity  to  training  effective¬ 
ness.  The  major  customer  for  this  work 
is  the  Training  Systems  Special  Project 
Office  of  the  Aeronautical  Systems  Divi¬ 
sion.  Particular  questions  of  interest 
to  them  include:  How  valuable  is  the 
training  provided  by  visual  systems?  How 
much  fidelity  is  required  to  support 
specific  training  objectives?  How  should 
the  visual  requirements  be  specified  in 
terms  of  engineering  parameters?  Re¬ 
search  in  this  area  also  includes  topics 
tied  to  programs  in  the  Division's  ad¬ 
vanced  technology  development  area  and 
to  visual-related  issues  of  interest  to 
the  Army  and  Navy.  This  portion  of  the 
visual  training  effectiveness  R&D  is 
coordinated  through  the  Visual  Training 
Effectiveness  Working  Group. 

Research  is  currently  ongoing  in  four 
areas:  (1)  target  display  requirements, 
(2)  scene  content,  (3)  field  of  view,  and 
(4)  the  use  of  color.  Ultimatelyj  train¬ 
ing  effectiveness  deals  with  transfer  of 
training  from  the  simulator  to  the  air¬ 
craft.  Due  to  the  cost,  time,  and  tech¬ 
nical  difficulties  involved  in  conducting 
transfer-of-training  experiments  for  each 
level  of  all  the  factors  involved,  an 
R&D  strategy  has  been  adopted  which  first 
searches  to  find  significant  performance 
differences  within  a  controlled  experi¬ 
mental  situation.  And  then  other  meas¬ 
ures  of  effectiveness  are  used  including 
within-simulator  performance  and  psycho¬ 
physical  perceptual  judgments.  When 
appropriate,  these  differences  are  veri¬ 
fied  using  a  transfer  test. 


In  order  to  support  this  R&D  program,  a 
wide  variety  of  equipment  is  required. 
At  present,  two  image  generators  are  be¬ 
ing  used  as  well  as  a  graphics  system. 
Displays  include  the  A-10  dodecahedron 
with  color  CRTs,  the  fiber-optic 
helmet-mounted  display  system,  and  the 
Visual  System  Component  Development  Pro¬ 
gram  limited-f ield-of-view  dome,  two 
smaller  5'  diameter  domes,  rear-projec¬ 
tion  screens  of  varying  gains,  and 
several  types  of  color  light  valve 
projectors . 

Two  other  R&D  efforts  have  been  started 
during  FY87  that  may  have  significant 
impact  on  future  design  requirements.  One 
project  involves  studying  the  effects  of 
display  parameters  such  as  update  rate, 
interlacing,  brightness,  and  contrast  on 
the  perception  of  form  and  motion  of  a 
moving  target.  This  area  of  R&D  is  crit¬ 
ical  to  the  development  of  satisfactory 
air-to-air  combat  training  displays. 
Results  obtained  to  date  show  that  inter¬ 
lacing  and  update  rate  both  impact  the 
perception  of  form  and  apparent  motion. 
The  magnitude  of  these  effects  and  the 
training  impact  on  realistic  tasks  have 
not  yet  been  established. 

Another  major  effort  initiated  during 
the  last  year  concerns  the  use  of  color 
in  out-of-the-cockpit  scenes.  Almost  all 
visual  systems  use  color.  However,  the 
colors  never  appear  realistic.  The 
Division  has  undertaken  a  program  which 
addresses  the  cause  of  this  problem  and 
will  provide  recommendations  for  solu¬ 
tions.  A  multiphased  approach  has  been 
taken  initially.  The  goal  is  to  define 
objectively  the  engineering  characteris¬ 
tics  of  the  color  displays,  and  to  deter¬ 
mine  how  to  control  the  color  output  and 
how  to  derive  a  scheme  for  assuring  that 
the  color  output  matches  the  intended 
color.  Ultimately,  the  R&D  will  investi¬ 
gate  the  optimal  use  of  color  for  render- 
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Basic  research  is  exploring  how  information  is 
selected  by  the  human  visual  system  for  processing. 


ing  realistic  scenes.  Because  the  appear¬ 
ance  of  color  changes  as  a  function  of 
the  brightness  levels,  the  Branch  has 
conducted  an  extensive  analysis  of  the 
brightness  levels  in  light  valve  projec¬ 
tion  and  large  CRT  displays  and  found 
them  to  be  in  about  the  bright  moonlight 
night  range. 

Quite  different  explanations  for  many  of 
the  problems  observed  focus  on  the  rela¬ 
tively  low  level  of  brightness  and  sub¬ 
stantial  day-to-day  variation  in  the 
displays,  combined  with  the  fact  that 
the  functions  relating  intended  color  to 
obtained  color  differ  between  CRTs  and 
light  valves. 

Since  most  color  science  is  based  upon 
higher  brightness  levels  than  those  used 
in  flight  simulators,  work  has  been 
started  to  objectively  define  how  the 
colors  will  appear  in  typical  scenes.  A 
comparison  of  the  color  production  of 
two  types  of  color  light  valve  projec¬ 
tors,  one  representing  state-of-the-art 
technology,  has  also  been  conducted.  The 


new  technology  seems  to  offer  better  pro¬ 
duction  and  control  of  certain  colors, 
but  the  value  in  terms  of  training 
benefits  has  not  yet  been  determined. 

Contact:  Dr.  Elizabeth  L.  Martin 

AFHRL/OTE 

Williams  AFB  AZ  85240-6457 
Commercial:  (602)  988-6561 

AUTOVON:  474-6561 


AIRCREW  TRAINING  BRANCH 

The  Aircrew  Training  Branch  (OTA)  is 
primarily  responsible  for  managing,  up¬ 
dating,  maintaining,  and  operating  the 
major  simulation  facilities  located  at 
Williams  AFB,  Arizona.  These  facilities 
provide  the  foundation  for  R&D  on  train¬ 
ing  effectiveness  and  flight  simulator 
engineering.  The  simulation  systems  in¬ 
clude  dome,  dodecahedron,  and  helmet- 
mounted  visual  displays;  computer  image 
generation  systems;  and  related  R&D 
equipment.  They  are  capable  of  simulat¬ 
ing  F-16A,  F-16C,  and  A-10  aircraft. 
These  simulation  systems  support  R&D 
conducted  under  Project  1123,  Flying 
Training  Development,  and  Project  6114, 
Flight  Simulation  Technology,  as  well  as 
R&D  conducted  under  Program  Element 
63227F,  Advanced  Simulator  Technology; 
and  thus  provide  the  primary  simulation 
capability  for  implementing,  demonstrat¬ 
ing,  and  testing  training  technology  and 
simulation  hardware  advancements. 

The  major  projects  supported  by  the 
Branch  are  1123,  2363,  2743,  and  6114. 
However,  there  are  several  other  note¬ 
worthy  Branch  activities.  These  activi¬ 
ties  center  around  the  implementation  of 
new  technologies  to  enhance  simulation 
performance . 

One  of  the  Division's  primary  R&D  systems 
is  the  F-16A  R&D  simulator.  This  system 
simulates  a  high-performance  F-16A  block 
15S  aircraft  using  a  limited-field-of- 
view  head-  and  eye-tracking  dome  display 
system  and  the  Advanced  Visual  Technology 
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AVTS  accesses  sixteen  cell  texture  maps,  creating 
a  realistic  nap-of-the-earth  flight  simulator. 


System  (AVTS)  computer  image  generator. 
To  provide  for  more  realistic  simulation, 
several  enhancements  are  being  made  to 
this  technology  demonstrator  simulator. 
Upgrades  include  new  computational  equip¬ 
ment,  60  Hz  aerodynamics,  a  new  advanced 
Instructor  Operator  Station  (lOS),  and  a 
highly  advanced  universal  I/O  linkage 
system.  This  universal  Input/Output 
(I/O)  linkage  system  is  part  of  a  dis¬ 
tributed  microprocessor  architecture 
(called  MST-2M)  that  can  be  upgraded  to 
full  flight  simulation  computation  capa¬ 
bility  if  desired.  Upgrading  the  F-16A 
will  be  the  first  step  toward  an  opera¬ 
tional  distributed  microprocessor  system 
that  will  take  advantage  of  the  new  gen¬ 
eration  of  high-speed  microprocessors  and 
high-speed  I/O  from  memory  to  cockpit 
(lowering  transport  delay).  The  new  lOS 
will  incorporate  the  latest  advancements 
that  the  Division  has  made  in  lOS  tech¬ 


nology  and  design  issues.  Integrated  with 
the  lOS  will  be  a  Second  Viewpoint  Con¬ 
trol  Station  (SVCS)  and  the  Air  Combat 
Performance  Measurement  System  (ACPMS). 
The  SVCS  will  provide  dual-ship  capabil¬ 
ity.  The  ACPMS  will  be  able  to  run  train¬ 
ing  missions  and  collect  data  for  R&D 
projects . 

Another  major  enhancement  being  imple¬ 
mented  into  the  Division's  simulation 
systems  is  an  enhancement  of  the  AVTS. 
The  addition  of  cell  texturing  to  the 
AVTS  provides  a  capability  for  higher- 
density  scene  content  for  use  in  low- 
altitude  training.  Synthetic  Aperture 
Radar  (SAR)  and  Forward  Looking  Infrared 
(FLIR)  channels  are  being  added.  The  SAR 
and  FLIR  will  be  correlated  with  the 
visual  scene.  The  update  speed  of  the 
AVTS  will  be  doubled  and  a  second  view¬ 
point  added. 


Contact:  Mr.  David  A.  Ratino 
AFHRL/OTA 

Williams  AFB,  AZ  85240-6457 
Commercial:  (602)  988-6561 
AUTOVON:  474-5561 


OPERATIONAL  UNIT  TRAINING  BRANCH 

The  Operational  Unit  Training  Branch 
(OTU)  is  responsible  for  R&D  programs 
directed  toward  solving  operational  prob¬ 
lems  in  Air  Force  aircrew  '  --aining  at 
the  individual,  crew,  and  team  levels. 
Branch  projects  address  all  facets  of 
aircrew  training  which  concern  acquisi¬ 
tion,  maintenance,  and  reacquisition  of 
flying  knowledge  and  skills  for  such 
units.  This  Branch's  primary  objectives 
are  to  increase  force  effectiveness  and 
survivability  through  enhanced  combat 
readiness  and  flying  safety.  These  goals 
are  accomplished  through  R&D  focused  upon 
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electronic  combat  training  systems,  de¬ 
velopment  and  implementation  of  aircrew 
performance  measurement,  simulator  in¬ 
structional  strategies  and  technologies, 
total  training  system  design,  training 
system/device  evaluations,  and  the  devel¬ 
opment  of  part-task  trainers  capable  of 
supporting  unit  training  needs.  OTU ' s 
products  are  data  bases,  procedures,  and 
training  devices  validated  through  exper¬ 
imentation,  field  studies,  and  demonstra¬ 
tions.  The  Branch'^  activities  promote 
the  use  of  new  training  methods  and 
efficient  simulation  utilization. 

The  Tactical  Air  Forces  must  always  train 
for  a  situation  that  they  hope  never  to 
face — combat.  Development  and  maintenance 
of  the  critical  war-fighting  skills  in¬ 
volve  a  complex  training  system  in  which 
academic  instruction  and  ground-bated 
simulation  must  be  interwoven  with  in¬ 
flight  training  to  accomplish  specific 


The  electronic  combat  training  effectiveness  project  will  determine 
the  optimal  mixture  of  media  for  effective  EC  training. 
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training  objectives.  Because  of  the 
difficulty  of  accomplishing  many  of  these 
training  objectives,  AFHRL/OTU  is  active¬ 
ly  conducting  training  R&D  with  the  Tac¬ 
tical  Air  Forces.  These  efforts  include 
identification  of  training  needs,  devel¬ 
opment  and  evaluation  of  training  alter¬ 
natives,  and  integration  of  cost- 
effective  training  as  part  of  the  total 
training  system. 

Another  program  within  OTU  involves  R&D 
in  the  area  of  electronic  combat  (EC) 
training.  EC  training  is  difficult 
because  of  the  complexity  of  the  training 
to  be  provided,  the  unusual  requirements 
for  secure  communications,  and  the  rapid 
rate  of  technological  change.  Full  mis¬ 
sion  simulators,  on-board  systems,  and 
part-task  trainers  can  all  provide  some 
of  the  training,  but  it  is  not  clear  how 
an  overall  system  should  be  designed  to 
effectively  integrate  the  various  compo¬ 
nents  of  aircrew  electronic  combat  train¬ 
ing.  Modular  components  are  needed,  and 
OTU  plans  to  develop  a  Modular  Threat 
Training  System  (MOTTS)  prior  to  FY89. 
MOTTS  will  then  be  used  as  input  to  a 
multithreat,  multiship,  electronic  combat 
training  system  to  be  completed  in  FY91. 

Objective  measures  of  air  combat  per¬ 
formance  for  ti lining  evaluation  and 
feedback  do  not  exist.  To  meet  this 
need.  Branch  personnel  have  developed  a 
performance  measurement  system  at  Luke 
AFB,  Arizona  that  collects  data  from  the 
Simulator  for  Air-to-Air  Combat  (SAAC) 
and  the  Air  Combat  Maneuvering  Instru¬ 
mentation  (ACMI)  ranges.  By  measuring 
the  same  air-to-air  performance  in  both 
facilities,  it  is  possible  to  collect  and 
compare  the  same  objective  performance 
data  in  the  simulator  and  the  real  world. 
The  system  is  designed  to  support  re¬ 
search  in  the  development  and  validation 
of  alternative  air-to-air  performance 
measures,  as  well  as  new  techniques  for 
graphically  displaying  air  combat  engage¬ 
ments.  Functional  capabilities  of  the 
system  include:  real-time  monitoring 
and  scoring  of  air  combat  performance, 
real-time  graphic  display  of  mission 
progress,  and  the  storage  of  parameters 
tieeded  to  support  ongoing  R&P.  The 


system  also  includes  capabilities  such 
as:  post-mission  graphic  replay  for  de¬ 
briefing,  a  data  base  management  system, 
and  a  statistical  package  for  analysis 
of  R&D  results. 

During  the  period  from  FY88  to  FY91,  work 
will  be  conducted  on  multicockpit  In¬ 
structor  Operator  Station  (lOS)  design 
guides  and  modular  lOS  software.  The 
multicockpit  lOS  will  be  capable  of  in¬ 
terfacing  with  eventual  prototype  config¬ 
urations  on  an  in-house  two-  to  four- 
cockpit  simulator  by  FY91.  The  modular 
software  (developed  as  part  of  a  joint- 
Service  program)  will  be  a  standard  lOS 
software  package  applicable  to  simulation 
in  general. 

Three  aircrew  performance  measurement 
efforts  will  be  conducted  from  FY88  to 
FY91.  The  first  effort  will  develop  and 
validate  plans  for  a  stand-alone 
Performance  Measurement  System  (FMS) 
which  is  capable  of  acquiring  data  from 
the  Simulator  for  Air-to-Air  Combat 
(SAAC)  as  well  as  Air  Combat  Maneuvering 
Instrumentation  (ACMI)  ranges.  This 
common-data  base  capability  will  be  very 
useful  for  R&D  purposes  as  well  as  for 
training  progression  purposes. 

A  second  effort  will  identify  and  quan¬ 
tify  relevant  pilot  behaviors  required 
to  defeat  threats  and  to  accomplish  mis¬ 
sion  objectives  in  surface  attack  maneu¬ 
vers  . 

A  third  will  develop  and  evaluate  a  pro¬ 
totype  Air  Combat  Assessment  and  Debrief¬ 
ing  System  (ACADS)  for  use  with  the  F-16 
aircraft.  Specific  components  of  this 
system  will  include:  (a)  a  flight  data 
recording  system  that  can  monitor  and 
record  the  necessary  parameters  on-board 
the  aircraft,  and  (b)  a  ground-based  pro¬ 
cessing  system  that  can  process  and  pre¬ 
sent  airborne  data  in  a  format  suitable 
for  performance  analysis  and  replay  after 
the  aircraft  has  landed.  ACADS  will  be 
functionally  similar  to  an  aircraft- 
mounted  ACMI  range  system  and  will  have 
the  capability  to  be  deployed  to  wing 
and  squadron  locations  and  used  for  local 
area  training. 


A  critical  component  of  ground  based  air¬ 
crew  simulators  is  the  instructor/opera¬ 
tor  station  (lOS).  The  lOS  is  the  medium 
through  which  users  control  the  instruc¬ 
tional  support  features  that  provide  air¬ 
crews  special  training  not  available  in 
the  aircraft.  This  Branch  is  responsible 
for  the  development  of  guidelines  and 
human  factors  data  bases  for  lOS  design. 
A  generic  lOS  design  concept  which  incor¬ 
porates  modular  and  transportable  soft¬ 
ware  is  actively  being  developed  and 
evaluated.  Also,  OTU  is  conducting  R&D 
efforts  on  optimizing  the  design  of  the 
man/machine  lOS  interface.  Such  prod¬ 
ucts  have  many  uses  in  the  development 
aTid  acquisition  of  simulator  lOSs  and 
instructional  support  capabilities.  At 
present,  the  primary  users  are  the  Aero¬ 
nautical  Systems  Division,  the  Major 
Commands,  and  DOD  contractors. 

At  the  Division's  Tucson  operating  loca¬ 
tion,  the  Tactical  Training  Evaluation 
Center  (TTEC),  established  in  1985,  is 
collocated  with  the  162d  Tactical  Fighter 
Wing  of  the  Arizona  Air  National  Guard. 
This  working  relationship  has  provided 
the  opportunity  to  participate  first-hand 
in  Low-Altitude  Training  (LAT)  R&D.  This 
is  the  only  LAT  program  currently  author¬ 
ized  for  the  Tactical  Air  Forces,  and  it 
has  already  resulted  in  the  development 
of  a  unique  LAT  flight  course  and  train¬ 
ing  manuals.  Development  of  a  part-task 
trainer  for  visual  cues  has  been  complet¬ 
ed  and  is  u=  3d  to  enhance  training  on 
low-altitude  flight.  In  the  near  future, 
the  TTEC  will  serve  as  an  operational 
training  RCD  laboratory  for  a  number  of 
projects,  such  as  an  in-house  effort  on 
visual  cueing  and  transfer-of-  raining 
studies  on  air-to-air  radar  intercept 
tasks.  Long-range  plans  include  in-depth 
analysis  of  aircrew  performance,  combat 
readiness,  and  workload. 

Another  important  role  played  by  many  of 
the  people  on  the  OTU  staff  is  that  of 
consultant,  or  subject-matter  expert. 
Serving  in  this  capacity,  OTU  personnel 
have  given  Air  Force  agencies  valuable 
assistance  concerning  electronic  combat 


training,  aircrew  training  device  evalua¬ 
tion,  computer-based  instruction  and  man¬ 
agement,  and  use  of  training  lesuurces. 
Although  these  interactions  account  for 
only  a  small  portion  of  total  duty  time, 
they  have  significant  impacts  that  di¬ 
rectly  result  in  changing  the  way  the  Air 
Force  conducts  its  aircrew  training. 


Part-Task  Training  R&D 

Today's  aircrews  must  be  highly  profi¬ 
cient  in  many  operational  skills.  The 
complex  tasks  confronting  pilots  and  air¬ 
crew  members  have  been  characterized  as 
comprising  procedural,  perceptual-motor, 
and  decisional  performance  elements.  The 
growing  complexity  of  combat  missions  and 
the  sophistication  of  aircraft  contribute 
to  an  increasing  demand  upon  the  training 
process  to  ensure  the  proficiency  of  air- 


Aircraft  avionics  systems  are  designed 
to  increase  survivability.  Included  are 
systems  such  as  radar  warning  receivers, 
chaff/flare  dispensers,  and  electronic 
counter-measures  pods.  These  systems  per¬ 
mit  aircrews  to  identify  and  monitor 
potential  threats  and  to  use  tactics  to 
defeat  them.  Survivability  in  combat 
is  essential,  but  aircrews  have  few 
opportunities  to  engage  in  realistic 
training  using  these  systems.  In  re¬ 
sponse  to  this  deficiency,  AFHRL/OT 
developed  and  validated  an  Electronic 
Combat  Part-Task  Trainer  (ECPTT)  using 
low-cost  microcomputer  technology.  Be¬ 
cause  the  software  runs  on  a  standard 
microcomputer  readily  available  through¬ 
out  the  Air  Force,  training  in  many  of 
the  basic  aspects  of  electronic  combat 
will  soon  be  available  at  the  squadron 
level  and  provide  virtually  unlimited 


practice  opportunities  to  aircrew  mem¬ 
bers.  Laboratory  R&D  on  part-task 
training  shows  the  potential  of  large- 
scale  training  benefits  versus  training 
dollars  invested  by  applying  micro¬ 
computer-based  training  devices  as  part- 
task  trainers.  Research  surveys  indica¬ 
ted:  (a)  a  need  for  in-depth  R&D  on 
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part-task  methodologies  for  spe¬ 
cific  types  of  training  tasks 
(particularly  decision  aspects); 

(b)  a  broad-impact  opportunity 
for  application  of  advanced, 
low-cost-technology  part-task 
trainers;  and  (c)  the  need  for 
demonstrations  in  real-world 
training  environments.  R&D  is¬ 
sues  include  identification  of 
specific  methods  to  optimize 
part-task  training  for  a  variety 
of  requirements. 

Research  and  development  in  this 
area  is  conducted  as  a  close 
dialog  between  the  user  and  the 
Laboratory.  Currently  the  Divi¬ 
sion  sponsors  a  "lab-in-the- 
field"  concept  development  pro¬ 
gram  with  each  of  three  users: 

Tactical  Air  Command  (TAC),  Strategic  The  most  recent  experimental  trainer  is 

Air  Command  (SAC),  and  Military  Airlift  the  Air  Intercept  Trainer  (AIT),  under 
Command  (MAC).  Trainer  design  employs  development  for  the  Air  National  Guard 

Instructional  Systems  Development  prin-  and  the  Tactical  Air  Command.  The  AIT 

ciples  including  task  analysis,  specifi-  is  capable  of  training  basic  radar  sys- 

cation  of  observable  training  objectives,  tern  operations  and  beyond  visual  range 

development  of  performance  criteria  and  aspects  of  air-to-air  intercepts.  The 

measures,  simulation  of  task  environments  trainer  simulates  the  relevant  instrumen- 

to  support  on-task  practice,  and  automat-  tation,  controls,  and  flight  dynamics  of 

ed  guidance  and  feedback  systems  to  sup-  the  F-16.  Initial  experimentation  on 

port  "stand-alone"  training.  The  lab-in-  training  effectiveness  shows  that  the  AIT 

the-field  concept  begins  at  the  time  the  is  an  effective  substitute  for  the  F-16 

trainer  is  delivered  to  the  user  as  an  flight  simulator  for  many  aspects  of  in- 

experimental  device.  tercept  training.  Acceptance  by  users  has 

been  enthusiastic  and  the  operational 
With  student  and  instructor  pilot  popula-  reliability  of  the  device  thus  far  is 

tions  participating  as  experimental  sub-  extremely  high.  The  AIT  will  continue 

jects,  each  trainer  undergoes  extensive  in  the  experimental  mode  for  the  next 

testing  and  modification  to  mature  and  year  as  enhancements  are  added  and  eval- 

validate  the  concept.  During  this  pro-  uated,  and  additional  experimentation 

cess,  researchers  manipulate  instruction-  proceeds.  Enhancements  include  a  refined 
al  methods  such  as  task  partitioning,  intercept  scoring  algorithm,  basic  skills 

sequence  of  instruction,  and  feedback.  pretest  module  (symbology  interpretation 

Media  variables  associated  with  hardware  and  switchology  proficiency),  automated 

and  software  characteristics  also  are  guidance  and  feedback,  and  experimental 

evaluated  to  optimize  training  effective-  data  collection  systems.  Experimental 

ness.  The  essential  thrust  of  this  pro-  tra’ning  devices  similar  in  concept  to 

cess  is  to  identify  critical  determinants  the  AIT  are  in  design  phases  for  SAC  and 

of  skill  development  for  selected  types  MAC. 

of  aircrew  training.  These  findings  will 

be  used  to  define  training  procedures  and  The  aggregate  knowledge  of  methods  and 

methods,  and  to  identify  the  requirements  technology  accruing  from  the  development 

of  task  fidelity  and  instructional  fea-  of  experimental  prototypes  will  be  used 

tures  and  other  design  requirements  for  to  develop  a  data  base  on  part-task 

operational  part-task  trainers.  training  methodology.  The  Division  is 
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sponsoring  a  separate,  related  R&D  en¬ 
deavor  to  develop  a  comprehensive  train¬ 
ing  methodology  model  for  part-task 
trainiig  which,  when  complete,  will  be 
available  to  Air  Force  training  designers 
and  managers  in  a  Decision  Support  System 
(DSS).  The  DSS  will  provide  convenient 
access  to  the  full  body  of  training 
knowledge  relevant  to  methods  selection 
for  a  useful  range  of  training  require¬ 
ments  within  the  target  training  commun¬ 
ity. 

Based  upon  the  success  of  experimental 
trainers  such  as  the  ECPTT  and  the  AIT, 
AFHRL/OT's  expanded  R&D  program  on  meth¬ 
ods  and  technology  solutions  for  part- 
task  training  will  eventually  lead  to 
intelligent,  automated  devices  which  can 
reduce  training  costs  while  increasing 
the  proficiency  and  readiness  of  opera¬ 
tion  .a  1  aircrews. 


Dr.  Bernell  J.  Edwards 
AFHRL/OTA 

Williams  AFB ,  AZ  85240-6457 
Commercial  (602)  988-6561 
AUTOVON  474-6561 


Total  Training  System  Design 

There  is  a  growing  recognition  in  the  Air 
Force  for  the  need  to  design  and  imple¬ 
ment  aircrew  training  programs  as  total 
integrated  systems  rather  than  as  dis¬ 
jointed  sets  of  components  and  phases  of 
training.  Many  traditional  programs  are 
comprised  of  phases  and  blocks  of  in¬ 
struction  that  have  been  independently 
developed  in  relative  isolation  from  the 
"system"  as  a  whole,  resulting  in  fre¬ 
quent  gaps  in  some  areas  and  unnecessary 
redundancies  in  others.  Resulting  pro¬ 
grams  are  inefficient  and  the  aircraft, 
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To  be  cost  effective,  a  training  program  must  consider 
the  total  integrated  training  system. 


which  is  usually  the  most  costly  resource 
in  the  program,  often  is  used  to  compen¬ 
sate  for  instructional  deficiencies  that 
should  have  been  corrected  in  much  less 
expensive  ways.  This  lack  of  integration 
into  a  unified  system  also  leads  to  pro¬ 
grams  that  are  relatively  inflexible  in 
adapting  to  change.  For  example,  when 
new  training  technologies  are  introduced 
that  should  improve  the  overall  cost 
effectiveness  of  the  program,  frequently 
nothing  else  in  the  program  is  changed; 
thus,  the  major  impact  is  an  overall 
increase  in  O&M  costs. 

The  Division  has  a  total  training  system 
design  R&D  program  directed  toward  pro¬ 
viding  guidelines  for  the  Air  Force.  The 
Model  Aircrew  Training  System  (MATS) 
produced  a  design  specification  for  a  new 
C-130  aircrew  training  system  that  took 
full  advantage  of  recent  advances  in  cog¬ 
nitive  psychology  and  training  technology 


to  optimize  training  effectiveness  and 
efficiency.  The  resulting  specification 
formed  the  foundation  for  the  C-130 
Aircrew  Training  System  (C-130  Aiaf.  The 
C-130  ATS  is  an  integrated  training  sys¬ 
tem  that  includes  all  phases  of  training. 
Training  is  proficiency-based  such  that 
student  progression  is  dependent  upon 
meeting  predefined  performance  standards 
rather  than  simply  completing  a  fixed 
number  of  training  events  or  sessions. 
Training  is  individualized  to  the  maximum 
extent  possible  so  that  both  the  rate  and 
content  of  training  are  tailored  to  the 
needs  and  capabilities  of  each  individual 
rather  than  to  the  class  as  a  whole. 
There  is  a  conscious  attempt  to  increase 
the  overall  cost  effectiveness  of  the 
system  and  its  ability  to  adapt  to  change 
through  the  rational  application  of 
advanced  concepts  in  training  design, 
development,  delivery,  and  management. 


Thi:'rr;‘  is  an  increasing  need  for  objective  air  combat  performance 
data  for  both  the  simulated  and  real-world  environments. 
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struction  of  combat  training  syllabi,  in 
which  the  optimal  training  scenario  con¬ 
tent  will  be  defined  for  close  air  sup¬ 
port  (A-10),  daytime  deep  strike  (F-16), 
and  night  attack  interdiction  (LANTIRN 
F-lb)  ( FY89 ) .  A  manual  for  total  train¬ 
ing  svstems  design  will  be  completed  in 
FYA2.  A  training  R&D  laboratory  (TRL) 
has  been  established  on-site  at  Little 
Rock  AFB,  AK  to  address  training  system 
design  issue's  in  the  context  of  the 
C-l'3iJ  ATS.  Initial  tasks  for  the  TRL 
are;  rie'velop  improvi'd  prr'ficiency 
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of  improved  performance  metrics.  MATS 
concepts  are  also  currently  being  applied 
to  the  modernization  of  B-52  and  KC-135 
aircrew  training.  In  addition  to  supply¬ 
ing  training  system  design  concepts,  OT 
is  also  working  with  the  Strategic  Air 
Command  (SAC)  to  identify  important 
training  system  evaluation  concepts, 
practices,  and  procedures  to  include  in 
the  specification  of  the  new  SAC  train¬ 


ing  systems.  One  major  product  of  this 
effort  will  be  the  formulation  of  a  test 
and  evaluation  plan  for  the  B-52  and 
KC-135  training  modernization  program. 
The  test  plan  will  be  responsive  to  the 
information  requirements  of  all  levels 
of  management,  and  it  will  enable  a  com¬ 
prehensive  assessment  of  the  effective¬ 
ness  and  efficiency  of  the  new  training 
system  and  its  components. 


The  Air  Combat  Performance  Measurement  System 
provides  for  post-mission  graphic  replay  for  debriefing. 
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Finally,  to  facilitate  transfer  of  les¬ 
sons  learned  to  other  training  systems, 
OT  is  developing  an  empirical  data  base 
to  capture  the  results  of  field  R&D  and 
results  of  evaluations  of  emerging  train¬ 
ing  systems.  Based  on  this  data  base, 
guidelines  and  model  specifications  will 
be  developed  addressing  the  design, 
acquisition,  and  operation  of  total  air¬ 
crew  training  systems  for  use  by  systems 


acquisition  offices  and  Air  Force  train¬ 
ing  organizations  to  enhance  the  cost 
effectiveness  of  training. 

Dr.  Robert  T.  Nullmeyer 
AFHRL/OTU 

Williams  AFB,  AZ  85240-6547 
Commercial  (602)  988-6561 
AUTOVON  474-6561 
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INFORMATION  SCIENCES  DIVISION 


The  Information  Sciences  Division,  locat¬ 
ed  at  Brooks  AFB,  Texas,  provides  support 
to  the  AFHRL  headquarters  and  the  four 
R&D  divisions.  This  support  includes  man¬ 
agement  and  operation  of  the  scientific 
data-process ing  center  of  AFHRL.  Office 
automation  services  are  also  provided  by 
the  Division.  Management  information  is 
maintained  on  a  VAX  computer  system.  The 
Division  develops,  maintains,  and  updates 


automated  personnel  and  training  R&D 
data  bases.  The  Division  also  provides 
consultative  and  programming  support  in 
the  formulation  of  R&D  efforts  and  the 
application  of  statistical  techniques  in 
support  of  other  Laboratory  divisions  and 
Air  Force  offices.  The  Division  manages 
the  scientific  and  technical  information 
program.  The  Division  is  organized  into 
four  branches  as  shown  below. 


I 

I 


SOFTWARE  &  DATA  BASE 
DEVELOPMENT  BRANCH 

The  Branch  provides  three  services: 

1.  Software  Development. 

2.  Research  Data  Base  Management. 

3.  Management  Information. 

Software  Development.  The  Branch  devel¬ 
ops,  maintains,  documents,  and  provides 
training  in  the  use  of  general-purpose 
computer  software.  This  software  includes 
the  broad  categories  of  (a)  language 
translators,  such  as  precompilers  and  in¬ 
terpreters;  (b)  utility  programs,  such 
as  sort/merge  and  report  writers;  (c) 
applications  programs,  such  as  correla¬ 
tion-regression  analysis  and  multidimen¬ 
sional  frequency  distributions;  and  (d) 


subroutine  libraries  containing  common 
computing  algorithms.  The  Branch  is 
responsible  for  more  than  460  general- 
purpose  and  statistical  analysis  programs 
and  4,000  pages  of  user  guides  to  those 
programs.  The  majority  of  this  software 
is  installed  on  the  UNISYS  1100,  and  a 
rapidly  growing  microcomputer  library  is 
being  developed. 

Research  Data  Base  Management.  The  analy¬ 
sis  of  relationships  between  personal 
characteristics  and  performance  during 
an  Air  Force  career  requires  the  exten¬ 
sive  use  of  data.  Experimental  tests  and 
performance  measurement  devices  are  ad¬ 
ministered  in  a  research  setting,  and 
these  results  are  ordinarily  correlated 
with  information  about  experimental  cases 
using  other  information  developed  on  the 
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same  cases  at  a  different  point  in  time, 
either  earlier  or  later  than  the  experi¬ 
mental  data.  Similarly,  studies  of 
career  progression  and  factors  related 
to  successful  completion  of  an  enlist¬ 
ment,  or  attrition,  require  the  analyst 
to  correlate  information  on  the  same 
individuals  across  a  time  span  of  several 
yea'^s.  The  major  operational  commands, 
who  i  background  and  performance  data  on 
military  personnel  are  initially  ac¬ 
quired,  retain  ti'ese  data  for  only  a 
limited  period — ordinarily  less  than  1 
year.  In  order  to  facilitate  R&D  on  the 
Air  Force  personnel  and  training  systems 
by  AFHRL  researchers,  automated  data  are 
obtained  from  the  major  operating  com¬ 
mands  on  a  recurring  basis.  These  data 
are  then  converted  for  use  in  the  AFHRL 
Computer  Center.  Based  on  experience 
with  specific  analyses  and  studies  by 
AFHRL  researchers  over  a  period  of  years, 
data  in  these  master  files  are  then 
reorganized  in  a  manner  calculated  to 
eliminate  as  much  of  the  overhead  as 
possible  in  the  context  of  specific 
studies.  Experience  has  also  indicated 
the  desirability  of  combining  information 
from  two  or  more  master  file  sources  to 
establish  ready-to-use  master  files  with 
a  common  set  of  data  for  each  case  in  the 
file.  The  availability  of  ^he  R&D  master 
files  makes  it  possible  for  researchers 
to  effectively  carry  out  comprehensive 
R&D  efforts  related  to  the  personnel  and 
training  systems  without  having  to  ini¬ 


tiate  arrangements  for  data  collection  on 
a  case-by-case  and  study-by-study  basis 
with  field  locations  in  major  operating 
commands.  The  AFHRL  R&D  master  files 
contain  data  that  reflect  the  personal 
characteristics  of  officers  and  enlisted 
personnel  at  time  of  entry  to  active 
duty,  performance  outcomes  during  flying 
or  technical  training,  career  status  at 
periodic  intervals,  and  information 
related  to  reenlistment  or  separation. 
Special  files  are  created  to  meet  long¬ 
term  study  requirements,  and  longitudinal 
files  have  been  constructed  to  facilitate 
studies  in  career  development.  Work  is 
underway  to  build  dynamic  officer  ^  .,d 
enlisted  data  base  systems  capable  of 
providing  responses  to  operational  and 
research  investigators.  These  data  base 
systems  will  eliminate  the  requirement 
for  many  small,  fragmented  data  bases  and 
further  reduce  the  startup  time  and  cost 
of  many  personnel  R&D  efforts. 


Major  master  personnel  files  are  main¬ 
tained  historically  on  Air  Force  enlisted 
and  officer  personnel  and  include  enlist¬ 
ed  strength  files  from  1964,  officer 
strength  files  from  1960,  officer  effec¬ 
tiveness  report  files  from  1956,  flying 
training  files  from  1964,  Air  National 
Guard  and  Air  Force  Reserve  files  from 
1970,  separated  officer  files  from  1963, 
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enlisted  separation  files  from  1956, 
Basic  Military  Training  files  from 
1956,  Officer  Training  School  files 
from  1973,  and  Reserve  Officer  Training 
School  (ROTC)  participant  files  from 
1970.  These  files  are  received  from 
various  Air  Force  agencies,  such  as  the 
Air  Force  Military  Personnel  Center,  Air 
Training  Command,  Air  University,  and  Air 
Force  Reserve  Personnel  Center.  Special 
longitudinal  files,  such  as  the  Airman 
Gain/Loss  and  Officer  Gain/Loss,  are 
developed  in-house  from  these  data  bases 
and  significantly  reduce  data  processing 
requirements  in  many  personnel  and  train¬ 
ing  R&D  efforts. 


In  order  to  understand  the  code  struc¬ 
tures  used  in  the  development  of  the  per¬ 
sonnel  files,  an  additional  data  base  was 
developed  and  is  maintained  by  AFHRL. 
This  data  base  is  the  File  Item  Data 
Organizer  (FIDO).  It  consists  of  select¬ 
ed  data  elements  and  code  definitions 
from  Air  Force  Regulation  700-20,  Air 
Force  Data  Dictionary,  and  earlier  code 
systems.  It  has  on-line  retrieval  capa¬ 
bility  for  current  and  historical  code 
values,  with  definitions  for  each  data 
element  that  appears  in  a  data  file.  The 
data  base  currently  contains  over  1,100 
Air  Force  and  DOD-defined  data  elements, 
enabling  a  researcher  to  obtain  English- 
language  meanings  for  each  code  value  in 
effect  for  any  particular  historical 
file.  FIDO  has  proven  to  be  a  valuable 
tool  for  improving  data  base  accuracy, 
both  at  AFHRL  and  other  agencies. 


Management  Information.  This  Branch  is 
also  the  focal  point  for  collecting  and 
displaying  data  used  in  the  management 
of  the  AFHRL  technical  program.  All 
Laboratory  divisions  and  staff  offices 
have  on-line  access  to  the  Human  Re¬ 
sources  Management  Information  System 
(HRMIS)  to  enter  and  retrieve  data.  HRMIS 
is  a  dynamic  data  base  which  currently 
contains  information  for  work  unit  man¬ 
agement,  funding  action,  R&D  contracts, 
purchase  requests,  TDY  management.  Com¬ 
puter  System  Requirements  Documents 
(CSRD)  tracking,  facilities  management, 
R&D  requirements,  interagency  agreements, 
and  Laboratory  personnel  management. 
Automated  data  transfer  is  being  done  to 
support  Defense  Technical  Information 
Center  (DTIC),  Human  Systems  Division 
(HSD),  and  accounting  and  finance  data 
bases.  Personnel  throughout  AFHRL  re¬ 
trieve  data  and  produce  reports  using  the 
AFHRL  data  base  and  the  Oracle  data  base 
management  system. 


RESEARCH  PROCESSING  BRANCH 


The  complexity  of  comprehensive  R&D 
efforts  performed  by  AFHRL  researchers 
frequently  leads  to  an  extensive  series 
of  data-processing  steps  and  use  of  AFHRL 
computer  resources.  The  design  and  con¬ 
duct  of  these  data-processing  steps  in 
many  cases  require  the  use  of  technical 
experts,  who  select  and  assemble  utility, 
general-purpose,  and  statistical  pro¬ 
grams.  Some  efforts  also  require  the 
development  of  unique  software.  In  many 
cases,  the  use  of  one  or  more  technical 
experts  who  have  a  working  knowledge  of 
the  R&D  master  files  is  critical.  T!ie 
Branch  maintains  a  staff  of  programmer 
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and  data  base  experts  who  support  the 
analysis  requirements  of  researchers. 
These  services  are  performed  in  response 
to  approved  work  requests  initiated  by 
all  AFHRL  divisions.  These  same  services 
are  available  to  approved  agencies  out¬ 
side  AFHRL.  Work  requests  are  initiated 
on  behalf  of  the  outside  customers  and 
then  processed  in  the  same  manner  as 
those  for  the  AFHRL  divisions.  In  addi¬ 
tion  to  processing  these  work  requests, 
the  Branch  performs  a  quality  review  of 
all  work  performed,  to  ensure  complete 
and  accurate  results.  Annually,  the 
Branch  services  over  200  R&D-data  proc¬ 
essing  requests. 

COMPUTER  OPERATIONS  BRANCH 

The  Computer  Operations  Branch  manages 
and  operates  a  computer  center  which  in¬ 
cludes  a  large-scale,  general-purpose 
UNISYS  1100  computer  system  to  support 
R&D  programs  of  AFHRL  and  the  Human 
Systems  Division  (HSD)  at  Brooks  AFB,  and 
the  Occupational  Measurement  Center  (OMC) 
and  the  Air  Force  Military  Personnel 
Center  (AFMPC)  at  Randolph  AFB.  A 
Digital  Equipment  Corporation  VAX  8600 
is  operated  by  the  Branch  to  provide 
specialized  support  to  the  Training 
Systems  Division  for  the  Instructional 
Support  System  (ISS)  and  the  Advanced  On- 
the-job  Training  System  (AOTS)  applica¬ 
tions.  A  Digital  Equipment  Corporation 
VAX  11/780  computer  system  provides  auto¬ 
mated  management  information  systems  in 
support  of  R&D  projects  within  AFHRL  and 
also  provides  an  interface  with  the  De¬ 
fense  Data  Network  (DDN).  A  Wang  Labora¬ 
tories  VS-100  computer  system  provides 
office  automation  support  within  AFHRL. 

The  Computer  Center  includes  a  magnetic 
tape  library,  which  houses  20,000  active 
tape  reels.  These  tapes  contain  histor¬ 
ical  data  from  Air  Force  personnel  files, 
which  include  master  files,  working  files 
created  from  data-process ing  work  re¬ 
quests,  and  system  and  application  soft¬ 
ware  . 


Over  300  authorized  users  access  the 
UNISYS  1100  system  via  dial-up  telephone 
lines,  dedicated  telephone  lines  (serv¬ 
icing  Randolph  AFB),  and  direct  connected 
terminals  at  AFHRL,  Brooks.  UNISYS  1100 
users  include  AFHRL  and  HSD  scientists 
and  contractors,  as  well  as  survey  ana¬ 
lysts  from  OMC  and  AFMPC. 


The  Wang  VS-100  computer  system  provides 
office  automation  support  within  AFHRL. 
This  system  provides  local  automated  word 
processing  capability  and  electronic  mail 
service  to  the  remote  AFHRL  divisions  and 
HQ  AFSC.  The  Wang  terminals  and  printers 
located  throughout  AFHRL  allow  users  to 
create,  edit,  reuse,  and  print  research 
reports,  correspondence,  etc.,  and  to 
store  documents  on  magnetic  disks  for 
later  retrieval  as  needed.  The  elec¬ 
tronic  mail  function  allows  transmission 
of  correspondence,  research  reports,  etc. 
to  all  AFHRL  divisions  and  HQ  AFSC. 

The  Branch  operates  a  high-speed  Westing- 
house  Learning  Corporation  Scanner  which 
supports  the  rapid  automation  of  a  Ic rge 
quantity  of  survey  and  research  data  c_'l- 
lected  by  T.aboratory  scientists  and  OMC 
occupational  analysts.  The  remote  divi¬ 
sions  of  AFHRL  and  the  headquarters  are 
equipped  with  a  visual /graphics  telecon¬ 
ferencing  system.  This  system  simultane- 
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ously  links  all  the  AFHRL  sites.  Such  a 
linkage  makes  it  possible  to  conduct  a 
presentation  at  any  of  the  AFHRL  sites, 
with  participation  at  each  of  the  other 
sites.  The  Advanced  Teleconferencing 
Multi-media  Communication  (ATMC)  equip¬ 
ment  is  the  heart  of  the  visual  confer¬ 
encing  capability.  One  ATMC  is  located 
at  each  of  the  remote  sites,  and  one  sys¬ 
tem,  together  with  a  backup,  is  located 
at  AFHRL  headquarters.  Each  ATMC  is  cap¬ 
able  of  creating,  storing,  and  retriev¬ 
ing  digital  color  imagery  consisting  of 
text,  graphics,  and/or  photographs  and 
subsequently  displaying  these  images 
locally  on  large-screen  display  systems 
or  on  color  monitors.  Using  this  system, 
full-scale  visual  and  color  video  confer¬ 
ences  can  be  conducted,  augmented  by 
voice  communication  channels  through  a 
specially  designed  bridge  located  at 
AFHRL  headquarters.  The  function  of  the 
bridge  is  to  balance  voice  signals,  mak¬ 
ing  it  possible  for  the  audio  conferenc¬ 
ing  operator  to  monitor  the  conference 
p^osively.  The  Branch  can  provide  var¬ 
ious  types  of  color  output,  such  as  tex¬ 
tual  slides,  pie  charts,  bargraphs,  and 
line  graphs,  suitable  for  viewgraph  and 
35mm  projection. 


SCIENTIFIC  AND  TECHNICAL 
INFORMATION  BRANCH 

The  Scientific  and  Technical  Information 
(STINFO)  Branch  plans  and  directs  the 
STINFO  program,  including  the  technical 
library,  to  meet  the  information  needs 
of  Laboratory  scientists  and  technicians 
in  managing,  monitoring,  and  conducting 
R&D.  The  Branch's  technical  editing 
function  reviews,  processes,  and  pub¬ 
lishes  results  of  R&D  projects  in  the 
form  of  technical  reports,  technical 
papers,  journal  articles,  special  re¬ 
ports,  professional  papers,  and  other 
documents.  Technical  editing  personnel 
provide  guidance  to  authors  and  contract 
monitors  to  ensure  that  publications 
comply  with  Government  regulations  and 
professional  standards.  They  also  monitor 
distribution  of  AFHRL  publications  and 
maintain  records  for  responding  to  infor¬ 
mational  requests  from  the  user  and 
scientific  communities.  STINFO  personnel 
identify  the  information  and  publicity 
needs  of  the  Laboratory  and  develop  news 
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articles,  newsletters,  reports,  bro¬ 
chures,  and  displays  to  meet  those  needs. 
The  Branch  provides  liaison  services 
between  the  HSD  Public  Affairs  Office  and 
the  Laboratory.  The  Branch  obtains 
clearance  of  information  for  public 
release;  arranges  <"or  visits  and  services 
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of  reporters,  photographers,  and  audio¬ 
visual  specialists;  and  performs  special 
public  relations  and  information  assign¬ 
ments  as  required.  Finally,  the  Branch 
maintains  the  AFHRL  historical  archives, 
answers  historical  inquiries,  and  pro¬ 
vides  information  for  the  HSD  History. 


Technical  Library 

The  services  provided  by  the  AFHRL  li¬ 
brary  include  the  acquisition  of  books, 
journals,  and  other  library  materials. 

Services  are  provided  for  the  command 
staff  offices  and  the  divisions  on 
Brooks  AFB,  as  well  as  for  divisions  and 
offices  located  in  other  geographical 
areas.  The  library  has  on-line  access 
to  the  Dialog  Information  Services,  Inc., 
at  Palo  Alto,  California;  the  Defense 
Technical  Information  Center's  Defense 
RDT&E  On-Line  System,  at  Alexandria, 
Virginia;  and  the  OCLC ,  a  national  li¬ 
brary  network,  through  the  AMIGOS  Bibli¬ 
ographic  Council,  Inc.,  Dallas,  Texas. 


PLANNING  FOR  THE  FUTURE 

New  procedures  and  equipment  can  enhance 
the  support  of  the  Division  to  the  Labo¬ 
ratory  R&D  program  and  the  Laboratory 
headquarters.  Active  studies  are  under¬ 
way  to  identify  the  requirements  for 


optical  disk,  to  augment  the  mass  storage 
system  on  the  UNISYS  computer.  Major 
sections  of  the  research  data  base  have 
been  identified  as  candidates  for  conver¬ 
sion  to  optical  disks.  Use  of  optical 
disk  will  significantly  reduce  the  turn¬ 
around  time  associated  with  the  process¬ 
ing  of  studies  which  use  the  research 
data  bases  and  decrease  the  requirements 
for  periodically  refreshing  the  large 
volume  of  magnetic  tape.  A  study  is 
underway  to  evaluate  low-cost  equipment 
as  a  possible  replacement  for  the  ATMC. 
Replacement  equipment  with  user-friendly 
software  will  enable  relatively  unskilled 
clerical  and  scientific  personnel  to 
develop  graphics  materials  as  needed. 


The  Technical  Library  will  install  ab¬ 
stracts  from  technical  journals  on  CD 
ROM,  facilitating  literature  searches  by 
researchers  and  scientists.  A  new  level 
of  software  is  being  installed  which  will 
significantly  speed  up  the  computation 
of  management  reports.  Major  revisions 
and  expansions  of  existing  management 
information  system  data  bases  are  being 
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actively  considered  to  better  address  the 
needs  of  the  Laboratory  headquarters  and 
staff,  as  well  as  the  research  divisions. 
The  VAX  8600  is  being  upgraded  to  a  VAX 
8650  in  order  to  assure  sufficient  com¬ 
putational  support  for  the  lOT&E  of  the 
Advanced  On-the-job  Training  System  at 
Bergstrom  AFB  scheduled  for  1988.  Signi¬ 
ficant  progress  has  been  made  in  stream¬ 
lining  the  processing  of  technical  re¬ 
ports  and  papers,  and  reducing  the  number 
of  delinquent  reports.  New  procedures 
are  being  implemented  to  automate  track¬ 
ing  of  the  status  of  reports  in  progress 
and  the  documentation  required  for  effec¬ 


tive  work  unit  management.  STINFO  focal 
points  at  the  divisions  will  be  trained 
by  the  Laboratory  STINFO  program  manager. 
Thus,  the  focal  points  will  be  the  key 
to  further  improvements  in  the  management 
of  the  Laboratory  STINFO  program.  While 
these  represent  some  examples  of  both 
processes  and  equipment  which  will  allow 
the  Division  to  maintain  its  level  of 
support  to  other  elements  of  the  Labora¬ 
tory,  Division  personnel  and  managers 
will  remain  constantly  alert  and  take 
aggressive  action  to  improve  both  the 
qual ity  and  quantity  of  services  provided 
by  the  Division. 
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